[ 530.776655] env[65234]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 530.776655] env[65234]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 531.801685] env[65322]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 531.801685] env[65322]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 533.354571] env[65322]: INFO neutron.common.config [-] Logging enabled! [ 533.354913] env[65322]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev113 [ 533.355155] env[65322]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65322) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 533.355464] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 533.355559] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 533.356380] env[65322]: WARNING oslo_policy.policy [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 533.356597] env[65322]: WARNING oslo_policy.policy [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 533.358256] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] VMware NSXv3 Agent initialized successfully. [ 533.358604] env[65322]: DEBUG oslo_concurrency.lockutils [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] Acquiring lock "singleton_lock" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.358731] env[65322]: DEBUG oslo_concurrency.lockutils [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] Acquired lock "singleton_lock" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.358934] env[65322]: DEBUG oslo_concurrency.lockutils [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] Releasing lock "singleton_lock" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.359228] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] Full set of CONF: {{(pid=65322) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:274}} [ 533.359336] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ******************************************************************************** {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 533.359432] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] Configuration options gathered from: {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 533.359771] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 533.359938] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 533.360056] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ================================================================================ {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 533.360223] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] agent_down_time = 75 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.360358] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] allow_automatic_dhcp_failover = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.360491] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] allow_bulk = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.360635] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] api_extensions_path = {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.360773] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] api_paste_config = api-paste.ini {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.360907] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] auth_strategy = keystone {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.361016] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] backdoor_port = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.361116] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] backdoor_socket = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.361247] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] backlog = 4096 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.361381] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] base_mac = fa:16:3e:00:00:00 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.361531] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] bind_host = 0.0.0.0 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.361669] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] bind_port = 9696 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.361798] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] client_socket_timeout = 900 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.361932] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] config_dir = [] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.362048] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.362183] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] config_source = [] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.362317] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] control_exchange = neutron {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.362449] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] core_plugin = ml2 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.362585] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] debug = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.362719] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] default_availability_zones = [] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.362917] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.363063] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] dhcp_agent_notification = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.363196] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] dhcp_agents_per_network = 1 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.363326] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] dhcp_lease_duration = 86400 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.363461] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] dhcp_load_type = networks {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.363592] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] dns_domain = openstacklocal {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.363725] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.363852] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] enable_default_route_bfd = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.363978] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] enable_default_route_ecmp = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.364118] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] enable_dvr = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.364245] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] enable_new_agents = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.364370] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.364495] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] enable_signals = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.364622] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] enable_traditional_dhcp = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.364745] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] external_dns_driver = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.364869] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] filter_validation = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.365008] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] global_physnet_mtu = 8950 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.365143] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] graceful_shutdown_timeout = 60 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.365312] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] host = cpu-1 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.365445] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] host_dvr_for_dhcp = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.365574] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] http_retries = 3 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.365708] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] instance_format = [instance: %(uuid)s] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.365839] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.365968] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ipam_driver = internal {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.366104] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ipv6_pd_enabled = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.366229] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] l3_ha = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.366358] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.366491] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] l3_ha_network_physical_name = {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.366620] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] l3_ha_network_type = {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.366756] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] log_color = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.366888] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] log_config_append = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.367027] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.367156] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] log_dir = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.367278] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] log_file = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.367374] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] log_options = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.367501] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] log_rotate_interval = 1 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.367631] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] log_rotate_interval_type = days {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.367761] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] log_rotation_type = none {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.367859] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.367955] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.368103] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.368234] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.368333] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.368462] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] max_dns_nameservers = 5 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.368590] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] max_header_line = 16384 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.368718] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] max_l3_agents_per_router = 3 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.368846] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] max_logfile_count = 30 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.368973] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] max_logfile_size_mb = 200 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.369202] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] max_subnet_host_routes = 20 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.369345] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] my_ip = 10.180.1.21 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.369478] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] my_ipv6 = ::1 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.369628] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] network_auto_schedule = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.369763] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] network_link_prefix = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.369903] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.370051] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] notify_nova_on_port_data_changes = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.370190] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] notify_nova_on_port_status_changes = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.370323] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] pagination_max_limit = -1 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.370452] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] publish_errors = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.370583] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] rate_limit_burst = 0 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.370717] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] rate_limit_except_level = CRITICAL {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.370843] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] rate_limit_interval = 0 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.370973] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] retry_until_window = 30 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.371114] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] router_distributed = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.371242] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] rpc_resources_processing_step = 20 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.371378] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] rpc_response_max_timeout = 600 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.371546] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] rpc_response_timeout = 60 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.371684] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] send_events_interval = 2 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.371829] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] service_plugins = ['router'] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.371965] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] setproctitle = on {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.372107] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] shell_completion = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.372242] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] state_path = /opt/stack/data/neutron {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.372379] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] syslog_log_facility = LOG_USER {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.372510] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] tcp_keepidle = 600 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.372645] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] transport_url = **** {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.372776] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] use_journal = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.372904] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] use_json = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.373042] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] use_ssl = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.373171] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] use_stderr = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.373305] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] use_syslog = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.373430] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] vlan_qinq = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.373555] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] vlan_transparent = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.373683] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] watch_log_file = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.373811] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] wsgi_default_pool_size = 100 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.373939] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] wsgi_keep_alive = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.374085] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.374215] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] wsgi_server_debug = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 533.374362] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_concurrency.disable_process_locking = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.374502] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.374644] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.374778] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.374916] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.375062] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.375199] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.375347] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] profiler.connection_string = messaging:// {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.375484] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] profiler.enabled = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.375622] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] profiler.es_doc_type = notification {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.375757] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] profiler.es_scroll_size = 10000 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.375894] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] profiler.es_scroll_time = 2m {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.376034] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] profiler.filter_error_trace = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.376172] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] profiler.hmac_keys = **** {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.376308] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] profiler.sentinel_service_name = mymaster {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.376447] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] profiler.socket_timeout = 0.1 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.376579] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] profiler.trace_requests = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.376712] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] profiler.trace_sqlalchemy = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.376857] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] profiler_jaeger.process_tags = {} {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.376988] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] profiler_jaeger.service_name_prefix = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.377134] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] profiler_otlp.service_name_prefix = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.377277] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_policy.enforce_new_defaults = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.377552] env[65322]: WARNING oslo_config.cfg [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 533.377697] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_policy.enforce_scope = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.377839] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_policy.policy_default_rule = default {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.377988] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.378139] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.378281] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.378413] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.378544] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.378673] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.378804] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.378944] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_policy.remote_timeout = 60.0 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.379101] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.379247] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] agent.extensions = [] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.379388] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.379533] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] service_providers.service_provider = [] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.379700] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] QUOTAS.default_quota = -1 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.379846] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.379980] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] QUOTAS.quota_floatingip = 50 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.380125] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] QUOTAS.quota_network = 100 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.380257] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] QUOTAS.quota_port = 500 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.380388] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.380518] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] QUOTAS.quota_router = 10 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.380648] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] QUOTAS.quota_security_group = 10 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.380777] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.380905] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] QUOTAS.quota_subnet = 100 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.381049] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] QUOTAS.track_quota_usage = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.381201] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.381330] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep.group = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.381460] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep.helper_command = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.381591] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep.log_daemon_traceback = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.381727] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.381866] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep.thread_pool_size = 8 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.382009] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep.user = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.382154] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.382284] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_dhcp_release.group = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.382411] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_dhcp_release.helper_command = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.382542] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.382675] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.382806] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.382936] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_dhcp_release.user = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.383081] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.383210] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_ovs_vsctl.group = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.383334] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_ovs_vsctl.helper_command = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.383460] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.383595] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.383729] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.383856] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_ovs_vsctl.user = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.383990] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_namespace.capabilities = [21] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.384128] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_namespace.group = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.384254] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_namespace.helper_command = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.384380] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_namespace.log_daemon_traceback = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.384511] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.384644] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_namespace.thread_pool_size = 8 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.384772] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_namespace.user = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.384905] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_conntrack.capabilities = [12] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.385039] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_conntrack.group = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.385168] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_conntrack.helper_command = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.385299] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.385432] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.385563] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.385691] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_conntrack.user = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.385826] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_link.capabilities = [12, 21] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.385963] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_link.group = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.386125] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_link.helper_command = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.386259] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_link.log_daemon_traceback = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.386393] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.386527] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_link.thread_pool_size = 8 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.386655] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] privsep_link.user = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.386804] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.386944] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.387087] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] AGENT.continue_on_failed_promotions = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.387215] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] AGENT.dscp = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.387345] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] AGENT.dscp_inherit = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.387483] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] AGENT.force_mp_to_policy = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.387612] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] AGENT.locking_coordinator_url = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.387743] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] AGENT.log_agent_heartbeats = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.387875] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] AGENT.logging_expire = 1 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.388017] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.388153] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.388290] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] AGENT.polling_interval = 240 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.388425] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.388561] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.388704] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] AGENT.report_interval = 30.0 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.388842] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.388979] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.389131] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.389266] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] AGENT.sync_skew = 60 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.389399] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] AGENT.synchronization_queue_size = 20 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.389537] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] AGENT.use_helper_for_ns_read = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.389696] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] SECURITYGROUP.enable_ipset = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.389839] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] SECURITYGROUP.enable_security_group = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.389977] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.390125] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.390266] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] experimental.ipv6_pd_enabled = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.390417] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ml2.extension_drivers = ['port_security'] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.390562] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ml2.external_network_type = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.390719] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.390862] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ml2.overlay_ip_version = 4 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.390998] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ml2.path_mtu = 8950 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.391147] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ml2.physical_network_mtus = {} {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.391291] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ml2.tenant_network_types = ['vlan'] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.391430] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.391571] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ml2.type_drivers = ['vlan'] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.391713] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] AGENT_CLI.neutron_port_id = [] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.391851] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.392046] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.392205] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.392352] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.392489] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.392649] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.392805] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.392945] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.393151] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.393298] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] NSXV3.nsxv3_login_password = **** {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.393439] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] NSXV3.nsxv3_login_port = 443 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.393575] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] NSXV3.nsxv3_login_user = admin {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.393715] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.393854] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.393990] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.394135] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.394276] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.394417] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.394556] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.394695] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.394832] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.394969] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.395122] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.395256] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.395391] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.395578] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.395724] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] vsphere.vsphere_login_password = VMware1! {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.395857] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.395988] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.396138] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] nova.auth_section = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.396279] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] nova.auth_type = password {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.396414] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.396544] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] nova.certfile = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.396677] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] nova.collect_timing = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.396816] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] nova.endpoint_type = public {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.396948] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] nova.insecure = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.397087] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] nova.keyfile = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.397225] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] nova.region_name = RegionOne {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.397361] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] nova.split_loggers = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.397491] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] nova.timeout = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.397626] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] placement.auth_section = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.397768] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] placement.auth_type = password {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.397906] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.398045] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] placement.certfile = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.398182] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] placement.collect_timing = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.398318] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] placement.endpoint_type = public {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.398447] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] placement.insecure = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.398582] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] placement.keyfile = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.398710] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] placement.region_name = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.398839] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] placement.split_loggers = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.398962] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] placement.timeout = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.399106] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ironic.auth_section = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.399237] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ironic.auth_type = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.399363] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ironic.cafile = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.399487] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ironic.certfile = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.399643] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ironic.collect_timing = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.399779] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ironic.connect_retries = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.399909] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ironic.connect_retry_delay = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.400052] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ironic.enable_notifications = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.400183] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ironic.endpoint_override = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.400316] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ironic.insecure = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.400445] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ironic.interface = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.400605] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ironic.keyfile = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.400804] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ironic.max_version = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.400946] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ironic.min_version = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.401087] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ironic.region_name = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.401219] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ironic.retriable_status_codes = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.401347] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ironic.service_name = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.401471] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ironic.service_type = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.401600] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ironic.split_loggers = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.401729] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ironic.status_code_retries = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.401859] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ironic.status_code_retry_delay = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.401983] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ironic.timeout = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.402124] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ironic.valid_interfaces = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.402252] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ironic.version = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.402390] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] cli_script.dry_run = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.402534] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.402667] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.402798] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.402927] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.403068] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.403202] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.403332] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.403462] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.403591] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.403730] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.403858] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.403991] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.404140] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.404273] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.404402] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.404538] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.404710] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.404884] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.405042] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.405180] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.405312] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.405440] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.405571] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.405704] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.405834] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.405964] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.406105] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.406233] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.406361] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.406488] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.406617] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.ssl = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.406754] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.406887] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.407023] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.407161] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.407293] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.ssl_version = {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.407495] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.407688] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_notifications.driver = [] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.407886] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_notifications.retry = -1 {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.408063] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.408200] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] oslo_messaging_notifications.transport_url = **** {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 533.408303] env[65322]: DEBUG oslo_service.backend._eventlet.service [None req-e5da552d-e8a2-4a33-86c6-400ab4a20acc None None] ******************************************************************************** {{(pid=65322) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 533.409418] env[65322]: DEBUG neutron.agent.securitygroups_rpc [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Init firewall settings (driver=nsxv3) {{(pid=65322) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 533.410755] env[65322]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65322) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 533.410989] env[65322]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] RPC agent_id: nsxm-l-01a.corp.local [ 533.413242] env[65322]: DEBUG dogpile.cache.region [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 533.413358] env[65322]: DEBUG dogpile.lock [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 533.413459] env[65322]: DEBUG dogpile.lock [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 533.413545] env[65322]: DEBUG dogpile.lock [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 533.413635] env[65322]: DEBUG dogpile.cache.region [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 533.413730] env[65322]: DEBUG dogpile.lock [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 533.413918] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 533.489262] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Session token - acquiring [ 533.491255] env[65322]: DEBUG networking_nsxv3.common.locking [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.491479] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.491579] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.492061] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.506820] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 533.779466] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 533.804504] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 533.804658] env[65322]: DEBUG dogpile.cache.region [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Cache value generated in 0.391 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 533.804693] env[65322]: DEBUG dogpile.lock [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 533.804834] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Activating Policy API Provider. [ 533.805020] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Looking for the default Infrastructure Rules. [ 533.888233] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Looking for the Default Layer3 Logged Drop Section. [ 533.903380] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 533.903842] env[65322]: DEBUG networking_nsxv3.common.locking [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 533.904017] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquiring lock "all" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 533.904120] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquired lock "all" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 533.904396] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquired external semaphore "all" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 533.904727] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 534.419463] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 534.921411] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 535.423955] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Inventory metadata is going to be refreshed. [ 535.424345] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 536.202961] env[65322]: DEBUG networking_nsxv3.common.locking [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.203269] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.203269] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 536.205017] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 536.214418] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 536.216393] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 536.217116] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 536.236064] env[65322]: DEBUG networking_nsxv3.common.locking [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.236525] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.236756] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 536.237139] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 536.237372] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 536.237612] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 536.237810] env[65322]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65322) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 536.238016] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 536.256817] env[65322]: DEBUG networking_nsxv3.common.locking [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.257242] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.257448] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 536.259017] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 536.259017] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 536.259017] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 536.278647] env[65322]: DEBUG networking_nsxv3.common.locking [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.279065] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.279267] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 536.279766] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 536.280088] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 536.280350] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 536.299260] env[65322]: DEBUG networking_nsxv3.common.locking [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.300448] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquiring lock "Address Group" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.300698] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquired lock "Address Group" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 536.302745] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquired external semaphore "Address Group" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 536.302745] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Releasing lock "Address Group" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 536.302745] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 536.302745] env[65322]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65322) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 536.302745] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 536.322911] env[65322]: DEBUG networking_nsxv3.common.locking [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.322911] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquiring lock "Segment QoS" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.322911] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquired lock "Segment QoS" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 536.322911] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquired external semaphore "Segment QoS" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 536.322911] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Releasing lock "Segment QoS" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 536.322911] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 536.322911] env[65322]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65322) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 536.322911] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 536.345021] env[65322]: DEBUG networking_nsxv3.common.locking [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.345021] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.345021] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 536.345021] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 536.345021] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 536.345021] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 536.345021] env[65322]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65322) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 536.345021] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Inventory metadata have been refreshed. [ 536.345021] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Dryrun:True. Metadata refresh completed. [ 536.345021] env[65322]: DEBUG oslo_concurrency.lockutils [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Releasing lock "all" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 536.346617] env[65322]: INFO neutron.agent.agent_extensions_manager [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Loaded agent extensions: [] [ 536.347491] env[65322]: DEBUG neutron_lib.callbacks.manager [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65322) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 536.408104] env[65322]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] NSXv3 Agent Agent RPC Daemon Started! [ 536.408235] env[65322]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] NSXv3 Agent Agent loop - iteration:0 started [ 536.408341] env[65322]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] NSXv3 Agent Agent out of sync with plugin! [ 541.348387] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 541.348635] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 546.349971] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 546.350464] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 551.262397] env[65322]: INFO networking_nsxv3.common.synchronization [None req-e1d88531-163d-4888-9e9f-4f8d1ca088a0 demo admin] Enqueued Resource ID: 53bf5dff-57ff-4b9d-b8c2-4508c9e897d9 with Priority: HIGHEST for action security_group_rules [ 551.264708] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53bf5dff-57ff-4b9d-b8c2-4508c9e897d9 with Priority: HIGHEST for action security_group_rules [ 551.265062] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-53bf5dff-57ff-4b9d-b8c2-4508c9e897d9 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.265204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-53bf5dff-57ff-4b9d-b8c2-4508c9e897d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.265271] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-53bf5dff-57ff-4b9d-b8c2-4508c9e897d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 551.265618] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-53bf5dff-57ff-4b9d-b8c2-4508c9e897d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 551.265705] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('53bf5dff-57ff-4b9d-b8c2-4508c9e897d9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 551.790838] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.791086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.791156] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 551.791318] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 551.791407] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 551.791499] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 53bf5dff-57ff-4b9d-b8c2-4508c9e897d9 already deleted. [ 551.791578] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-53bf5dff-57ff-4b9d-b8c2-4508c9e897d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.265891] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 556.266288] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 561.267436] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 561.267436] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 566.269031] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 566.269420] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 571.270433] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 571.270794] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 572.351464] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.351895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.351895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.351895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.352070] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.855287] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.357855] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.861896] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 573.862071] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 574.623470] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.624079] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.624079] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.624079] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.634904] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 574.639164] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.641920] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 574.662571] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.662860] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.662860] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.663019] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.663100] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.663214] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 574.663276] env[65322]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65322) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 574.663344] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 574.686297] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.686538] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.686608] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.686823] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.686971] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.687098] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 574.710529] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.710810] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.710810] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.710928] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.711034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.711313] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 574.733570] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.733832] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.733832] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.733964] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.734065] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.734178] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 574.734251] env[65322]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65322) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 574.734310] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 574.761176] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.761341] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.761460] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.762925] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.762925] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.762925] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 574.762925] env[65322]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65322) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 574.762925] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 574.788422] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.788590] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.788687] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.788843] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.788916] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.789043] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 574.789110] env[65322]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65322) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 574.789174] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 574.789234] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 574.789319] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 574.789384] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 574.789437] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 574.789685] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 574.789773] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 574.789823] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 574.813912] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.814128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.814128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.814318] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.814417] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.814522] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 574.838545] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.838844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.838844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.839013] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.839121] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.884521] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.272098] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 576.272098] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 578.341254] env[65322]: INFO networking_nsxv3.common.synchronization [None req-81d7a9b5-5f1c-4ff3-8004-836b4369c230 None None] Enqueued Resource ID: 663639d6-cfdc-4dce-b419-c6d38d9ec0ef with Priority: HIGHEST for action port [ 578.341254] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 663639d6-cfdc-4dce-b419-c6d38d9ec0ef with Priority: HIGHEST for action port [ 578.341254] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-663639d6-cfdc-4dce-b419-c6d38d9ec0ef taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.341254] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-663639d6-cfdc-4dce-b419-c6d38d9ec0ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.341254] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-663639d6-cfdc-4dce-b419-c6d38d9ec0ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.341254] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-663639d6-cfdc-4dce-b419-c6d38d9ec0ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.341254] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('663639d6-cfdc-4dce-b419-c6d38d9ec0ef',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.844851] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 663639d6-cfdc-4dce-b419-c6d38d9ec0ef [ 578.845016] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.845167] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.845230] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.845495] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.845667] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.845667] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:663639d6-cfdc-4dce-b419-c6d38d9ec0ef already deleted. [ 578.845732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-663639d6-cfdc-4dce-b419-c6d38d9ec0ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.161718] env[65322]: INFO networking_nsxv3.common.synchronization [None req-9b657079-efb7-4931-b619-45e4ee156fea None None] Enqueued Resource ID: a43e551c-ca65-4e02-a541-52d16852c148 with Priority: HIGHEST for action port [ 580.162283] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a43e551c-ca65-4e02-a541-52d16852c148 with Priority: HIGHEST for action port [ 580.162576] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-a43e551c-ca65-4e02-a541-52d16852c148 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.162700] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a43e551c-ca65-4e02-a541-52d16852c148" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.162768] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a43e551c-ca65-4e02-a541-52d16852c148" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.163015] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a43e551c-ca65-4e02-a541-52d16852c148" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.164255] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a43e551c-ca65-4e02-a541-52d16852c148',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.671397] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a43e551c-ca65-4e02-a541-52d16852c148 [ 580.671397] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.671397] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.671397] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.671397] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.671397] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.671397] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a43e551c-ca65-4e02-a541-52d16852c148 already deleted. [ 580.671397] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a43e551c-ca65-4e02-a541-52d16852c148" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.436809] env[65322]: INFO networking_nsxv3.common.synchronization [None req-1012182b-db5b-4c1d-80cb-eb9b18a8b420 None None] Enqueued Resource ID: a87553dd-0456-47fe-8dc5-393daddfc656 with Priority: HIGHEST for action port [ 583.437140] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a87553dd-0456-47fe-8dc5-393daddfc656 with Priority: HIGHEST for action port [ 583.438635] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-a87553dd-0456-47fe-8dc5-393daddfc656 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.438635] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a87553dd-0456-47fe-8dc5-393daddfc656" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.438635] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a87553dd-0456-47fe-8dc5-393daddfc656" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.440665] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a87553dd-0456-47fe-8dc5-393daddfc656" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.440665] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a87553dd-0456-47fe-8dc5-393daddfc656',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.942262] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a87553dd-0456-47fe-8dc5-393daddfc656 [ 583.946020] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.946020] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.946020] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.946020] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.946020] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.946020] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a87553dd-0456-47fe-8dc5-393daddfc656 already deleted. [ 583.946020] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a87553dd-0456-47fe-8dc5-393daddfc656" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.036931] env[65322]: INFO networking_nsxv3.common.synchronization [None req-6a770dbe-c47f-40a5-ae41-75fd6d6ecd01 None None] Enqueued Resource ID: 49fa9a27-c2d3-46b9-b4bf-f6b3862b409e with Priority: HIGHEST for action port [ 584.037146] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49fa9a27-c2d3-46b9-b4bf-f6b3862b409e with Priority: HIGHEST for action port [ 584.037445] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-49fa9a27-c2d3-46b9-b4bf-f6b3862b409e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.037875] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-49fa9a27-c2d3-46b9-b4bf-f6b3862b409e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.037875] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-49fa9a27-c2d3-46b9-b4bf-f6b3862b409e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.037875] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-49fa9a27-c2d3-46b9-b4bf-f6b3862b409e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.038044] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('49fa9a27-c2d3-46b9-b4bf-f6b3862b409e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.195904] env[65322]: INFO networking_nsxv3.common.synchronization [None req-2b883d84-e98c-44a2-aca3-201565568332 None None] Enqueued Resource ID: 4eb10829-0ad1-47ac-bedd-27086027ceab with Priority: HIGHEST for action port [ 584.197937] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb10829-0ad1-47ac-bedd-27086027ceab with Priority: HIGHEST for action port [ 584.197937] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-4eb10829-0ad1-47ac-bedd-27086027ceab taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.197937] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4eb10829-0ad1-47ac-bedd-27086027ceab" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.197937] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4eb10829-0ad1-47ac-bedd-27086027ceab" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.197937] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4eb10829-0ad1-47ac-bedd-27086027ceab" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.197937] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4eb10829-0ad1-47ac-bedd-27086027ceab',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.546017] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 49fa9a27-c2d3-46b9-b4bf-f6b3862b409e [ 584.546017] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.546017] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.546017] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.546017] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.546017] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.546017] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:49fa9a27-c2d3-46b9-b4bf-f6b3862b409e already deleted. [ 584.546017] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-49fa9a27-c2d3-46b9-b4bf-f6b3862b409e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.700481] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4eb10829-0ad1-47ac-bedd-27086027ceab [ 584.700862] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.701125] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.701292] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.701893] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.702097] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.702502] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4eb10829-0ad1-47ac-bedd-27086027ceab already deleted. [ 584.702888] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4eb10829-0ad1-47ac-bedd-27086027ceab" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.200645] env[65322]: INFO networking_nsxv3.common.synchronization [None req-d55c2af0-c9f5-4110-a002-b8c890f2c575 None None] Enqueued Resource ID: b3dc7aad-07d3-4273-907f-2bd7a37b5e81 with Priority: HIGHEST for action port [ 585.201560] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3dc7aad-07d3-4273-907f-2bd7a37b5e81 with Priority: HIGHEST for action port [ 585.201560] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3dc7aad-07d3-4273-907f-2bd7a37b5e81 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.201720] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3dc7aad-07d3-4273-907f-2bd7a37b5e81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.201720] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3dc7aad-07d3-4273-907f-2bd7a37b5e81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.201930] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3dc7aad-07d3-4273-907f-2bd7a37b5e81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.202063] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3dc7aad-07d3-4273-907f-2bd7a37b5e81',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.705998] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3dc7aad-07d3-4273-907f-2bd7a37b5e81 [ 585.706291] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.706393] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.706461] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.706671] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.706761] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.706855] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3dc7aad-07d3-4273-907f-2bd7a37b5e81 already deleted. [ 585.706934] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3dc7aad-07d3-4273-907f-2bd7a37b5e81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.750155] env[65322]: INFO networking_nsxv3.common.synchronization [None req-9a0b4d12-927c-4bb0-aeeb-d19339dbc45c None None] Enqueued Resource ID: 9c3c8c6e-22c9-49f5-b7e6-0686a1410976 with Priority: HIGHEST for action port [ 585.750478] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c3c8c6e-22c9-49f5-b7e6-0686a1410976 with Priority: HIGHEST for action port [ 585.750994] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c3c8c6e-22c9-49f5-b7e6-0686a1410976 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.751747] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c3c8c6e-22c9-49f5-b7e6-0686a1410976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.751747] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c3c8c6e-22c9-49f5-b7e6-0686a1410976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.755228] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c3c8c6e-22c9-49f5-b7e6-0686a1410976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.755333] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c3c8c6e-22c9-49f5-b7e6-0686a1410976',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.155380] env[65322]: INFO networking_nsxv3.common.synchronization [None req-a275eea9-471b-463b-ba73-be01347bd5e6 None None] Enqueued Resource ID: 2fe17a31-5069-4269-9a3f-6d57fd722bce with Priority: HIGHEST for action port [ 586.156541] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fe17a31-5069-4269-9a3f-6d57fd722bce with Priority: HIGHEST for action port [ 586.157084] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fe17a31-5069-4269-9a3f-6d57fd722bce taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.157359] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fe17a31-5069-4269-9a3f-6d57fd722bce" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.157359] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fe17a31-5069-4269-9a3f-6d57fd722bce" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.158496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fe17a31-5069-4269-9a3f-6d57fd722bce" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.158496] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fe17a31-5069-4269-9a3f-6d57fd722bce',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.257575] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c3c8c6e-22c9-49f5-b7e6-0686a1410976 [ 586.259456] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.259456] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.259456] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.260605] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.260605] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.260840] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c3c8c6e-22c9-49f5-b7e6-0686a1410976 already deleted. [ 586.261078] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c3c8c6e-22c9-49f5-b7e6-0686a1410976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.662886] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2fe17a31-5069-4269-9a3f-6d57fd722bce [ 586.663140] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.663266] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.663332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.663545] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.663625] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.663716] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2fe17a31-5069-4269-9a3f-6d57fd722bce already deleted. [ 586.663791] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fe17a31-5069-4269-9a3f-6d57fd722bce" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.056772] env[65322]: INFO networking_nsxv3.common.synchronization [None req-8ed07c95-c01c-4d54-91ca-c10a915e8993 None None] Enqueued Resource ID: f6a14822-eb2f-49d5-95f8-08c31742a8a7 with Priority: HIGHEST for action port [ 587.056772] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6a14822-eb2f-49d5-95f8-08c31742a8a7 with Priority: HIGHEST for action port [ 587.057504] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6a14822-eb2f-49d5-95f8-08c31742a8a7 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.057650] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6a14822-eb2f-49d5-95f8-08c31742a8a7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.058066] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6a14822-eb2f-49d5-95f8-08c31742a8a7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.060323] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6a14822-eb2f-49d5-95f8-08c31742a8a7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.060376] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6a14822-eb2f-49d5-95f8-08c31742a8a7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.379121] env[65322]: INFO networking_nsxv3.common.synchronization [None req-d1c0621c-9304-4376-bc97-d3088531e299 None None] Enqueued Resource ID: e3c2a4ea-0703-4a7e-9e76-c6a56a84c028 with Priority: HIGHEST for action port [ 587.379450] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3c2a4ea-0703-4a7e-9e76-c6a56a84c028 with Priority: HIGHEST for action port [ 587.379849] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3c2a4ea-0703-4a7e-9e76-c6a56a84c028 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.379977] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3c2a4ea-0703-4a7e-9e76-c6a56a84c028" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.379977] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3c2a4ea-0703-4a7e-9e76-c6a56a84c028" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.381743] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3c2a4ea-0703-4a7e-9e76-c6a56a84c028" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.381743] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3c2a4ea-0703-4a7e-9e76-c6a56a84c028',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.562413] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6a14822-eb2f-49d5-95f8-08c31742a8a7 [ 587.562994] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.563170] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.563242] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.563452] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.564030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.564030] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6a14822-eb2f-49d5-95f8-08c31742a8a7 already deleted. [ 587.564030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6a14822-eb2f-49d5-95f8-08c31742a8a7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.854914] env[65322]: INFO networking_nsxv3.common.synchronization [None req-afc77a2d-e979-4c9d-8d61-36c8806e842b None None] Enqueued Resource ID: 044d9abe-11b6-434a-ba75-8d60f5660f7a with Priority: HIGHEST for action port [ 587.855664] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 044d9abe-11b6-434a-ba75-8d60f5660f7a with Priority: HIGHEST for action port [ 587.856668] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-044d9abe-11b6-434a-ba75-8d60f5660f7a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.856852] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-044d9abe-11b6-434a-ba75-8d60f5660f7a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.856922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-044d9abe-11b6-434a-ba75-8d60f5660f7a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.857295] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-044d9abe-11b6-434a-ba75-8d60f5660f7a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.857387] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('044d9abe-11b6-434a-ba75-8d60f5660f7a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.884495] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3c2a4ea-0703-4a7e-9e76-c6a56a84c028 [ 587.885987] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.886151] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.886200] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.886411] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.886504] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.886601] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3c2a4ea-0703-4a7e-9e76-c6a56a84c028 already deleted. [ 587.886679] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3c2a4ea-0703-4a7e-9e76-c6a56a84c028" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.360554] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 044d9abe-11b6-434a-ba75-8d60f5660f7a [ 588.360810] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.360909] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.360981] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.361255] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.361341] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.362911] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:044d9abe-11b6-434a-ba75-8d60f5660f7a already deleted. [ 588.362911] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-044d9abe-11b6-434a-ba75-8d60f5660f7a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.752899] env[65322]: INFO networking_nsxv3.common.synchronization [None req-9086b198-035b-4b4b-9212-f220e78c570c None None] Enqueued Resource ID: 69cd1837-0cf7-4a46-af3c-827e7d4a2b17 with Priority: HIGHEST for action port [ 588.753168] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69cd1837-0cf7-4a46-af3c-827e7d4a2b17 with Priority: HIGHEST for action port [ 588.753727] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-69cd1837-0cf7-4a46-af3c-827e7d4a2b17 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.753854] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-69cd1837-0cf7-4a46-af3c-827e7d4a2b17" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.753937] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-69cd1837-0cf7-4a46-af3c-827e7d4a2b17" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.755208] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-69cd1837-0cf7-4a46-af3c-827e7d4a2b17" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.755344] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('69cd1837-0cf7-4a46-af3c-827e7d4a2b17',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.260746] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 69cd1837-0cf7-4a46-af3c-827e7d4a2b17 [ 589.260746] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.260746] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.260746] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.260746] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.260746] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.260746] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:69cd1837-0cf7-4a46-af3c-827e7d4a2b17 already deleted. [ 589.260746] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-69cd1837-0cf7-4a46-af3c-827e7d4a2b17" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.247258] env[65322]: INFO networking_nsxv3.common.synchronization [None req-5f50feff-64d8-4d9a-b75a-97286dd82bfd None None] Enqueued Resource ID: e2a92671-d1d5-4ebc-ab46-59c2e9dbf694 with Priority: HIGHEST for action port [ 590.247520] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2a92671-d1d5-4ebc-ab46-59c2e9dbf694 with Priority: HIGHEST for action port [ 590.248946] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2a92671-d1d5-4ebc-ab46-59c2e9dbf694 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.248946] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2a92671-d1d5-4ebc-ab46-59c2e9dbf694" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.248946] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2a92671-d1d5-4ebc-ab46-59c2e9dbf694" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.248946] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2a92671-d1d5-4ebc-ab46-59c2e9dbf694" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.248946] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2a92671-d1d5-4ebc-ab46-59c2e9dbf694',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.393581] env[65322]: INFO networking_nsxv3.common.synchronization [None req-e224591e-d38f-49bb-9a79-7faf765d6048 None None] Enqueued Resource ID: 3edd2cd7-7aa8-416c-bb50-82d709112019 with Priority: HIGHEST for action port [ 590.394156] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3edd2cd7-7aa8-416c-bb50-82d709112019 with Priority: HIGHEST for action port [ 590.394997] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-3edd2cd7-7aa8-416c-bb50-82d709112019 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.394997] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3edd2cd7-7aa8-416c-bb50-82d709112019" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.394997] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3edd2cd7-7aa8-416c-bb50-82d709112019" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.394997] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3edd2cd7-7aa8-416c-bb50-82d709112019" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.395219] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3edd2cd7-7aa8-416c-bb50-82d709112019',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.752998] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e2a92671-d1d5-4ebc-ab46-59c2e9dbf694 [ 590.753216] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.753356] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.753426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.753804] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.753804] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.753804] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e2a92671-d1d5-4ebc-ab46-59c2e9dbf694 already deleted. [ 590.753906] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2a92671-d1d5-4ebc-ab46-59c2e9dbf694" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.897693] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3edd2cd7-7aa8-416c-bb50-82d709112019 [ 590.898123] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.898123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.898258] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.898727] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.898727] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.898727] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3edd2cd7-7aa8-416c-bb50-82d709112019 already deleted. [ 590.899031] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3edd2cd7-7aa8-416c-bb50-82d709112019" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.077706] env[65322]: INFO networking_nsxv3.common.synchronization [None req-ce452895-4a6e-415e-80b6-9855e91c9431 None None] Enqueued Resource ID: d7e7c283-57b7-409c-b214-7905d849a3d6 with Priority: HIGHEST for action port [ 593.078374] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7e7c283-57b7-409c-b214-7905d849a3d6 with Priority: HIGHEST for action port [ 593.078703] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7e7c283-57b7-409c-b214-7905d849a3d6 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.078800] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7e7c283-57b7-409c-b214-7905d849a3d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.078868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7e7c283-57b7-409c-b214-7905d849a3d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.079135] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7e7c283-57b7-409c-b214-7905d849a3d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.079223] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7e7c283-57b7-409c-b214-7905d849a3d6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.126431] env[65322]: INFO networking_nsxv3.common.synchronization [None req-a88fead0-13ad-4d69-8ea4-3f65868909fc None None] Enqueued Resource ID: 9b79ed3d-11d1-406d-8680-f8fa5421caf5 with Priority: HIGHEST for action port [ 593.126935] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b79ed3d-11d1-406d-8680-f8fa5421caf5 with Priority: HIGHEST for action port [ 593.127328] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b79ed3d-11d1-406d-8680-f8fa5421caf5 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.127328] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b79ed3d-11d1-406d-8680-f8fa5421caf5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.130047] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b79ed3d-11d1-406d-8680-f8fa5421caf5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.130047] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b79ed3d-11d1-406d-8680-f8fa5421caf5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.130047] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b79ed3d-11d1-406d-8680-f8fa5421caf5',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.309124] env[65322]: INFO networking_nsxv3.common.synchronization [None req-15b89ce6-e921-4e10-83ab-255c606b53ae None None] Enqueued Resource ID: 7f59c4f8-99cf-4e5f-b432-5823aa072de8 with Priority: HIGHEST for action port [ 593.309854] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f59c4f8-99cf-4e5f-b432-5823aa072de8 with Priority: HIGHEST for action port [ 593.309997] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f59c4f8-99cf-4e5f-b432-5823aa072de8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.310136] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f59c4f8-99cf-4e5f-b432-5823aa072de8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.310202] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f59c4f8-99cf-4e5f-b432-5823aa072de8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.311022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f59c4f8-99cf-4e5f-b432-5823aa072de8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.311022] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f59c4f8-99cf-4e5f-b432-5823aa072de8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.581775] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7e7c283-57b7-409c-b214-7905d849a3d6 [ 593.581842] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.581950] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.582030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.582250] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.582465] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.582557] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7e7c283-57b7-409c-b214-7905d849a3d6 already deleted. [ 593.582638] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7e7c283-57b7-409c-b214-7905d849a3d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.631567] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b79ed3d-11d1-406d-8680-f8fa5421caf5 [ 593.631567] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.631567] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.631567] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.631567] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.631567] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.631851] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b79ed3d-11d1-406d-8680-f8fa5421caf5 already deleted. [ 593.631851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b79ed3d-11d1-406d-8680-f8fa5421caf5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.685934] env[65322]: INFO networking_nsxv3.common.synchronization [None req-31a6f35e-1750-4453-bdd8-4fb53ab6c4e3 None None] Enqueued Resource ID: 806bb6ed-46d3-4985-80d2-a2831469ade5 with Priority: HIGHEST for action port [ 593.686187] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 806bb6ed-46d3-4985-80d2-a2831469ade5 with Priority: HIGHEST for action port [ 593.686715] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-806bb6ed-46d3-4985-80d2-a2831469ade5 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.686837] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-806bb6ed-46d3-4985-80d2-a2831469ade5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.686907] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-806bb6ed-46d3-4985-80d2-a2831469ade5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.687193] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-806bb6ed-46d3-4985-80d2-a2831469ade5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.687566] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('806bb6ed-46d3-4985-80d2-a2831469ade5',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.815639] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f59c4f8-99cf-4e5f-b432-5823aa072de8 [ 593.816053] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.816219] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.816271] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.816458] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.816897] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.816897] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f59c4f8-99cf-4e5f-b432-5823aa072de8 already deleted. [ 593.816897] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f59c4f8-99cf-4e5f-b432-5823aa072de8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.189748] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 806bb6ed-46d3-4985-80d2-a2831469ade5 [ 594.193341] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.193489] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.193578] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.193768] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.197019] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.197019] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:806bb6ed-46d3-4985-80d2-a2831469ade5 already deleted. [ 594.197019] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-806bb6ed-46d3-4985-80d2-a2831469ade5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.648235] env[65322]: INFO networking_nsxv3.common.synchronization [None req-e85cf7fb-2d17-4c42-8bd4-80cfe710203c None None] Enqueued Resource ID: 6309188d-3f53-4dd2-b185-6544199024ad with Priority: HIGHEST for action port [ 594.648560] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6309188d-3f53-4dd2-b185-6544199024ad with Priority: HIGHEST for action port [ 594.649053] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-6309188d-3f53-4dd2-b185-6544199024ad taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.649180] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6309188d-3f53-4dd2-b185-6544199024ad" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.649246] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6309188d-3f53-4dd2-b185-6544199024ad" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.649505] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6309188d-3f53-4dd2-b185-6544199024ad" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.649593] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6309188d-3f53-4dd2-b185-6544199024ad',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.105017] env[65322]: INFO networking_nsxv3.common.synchronization [None req-ee514bff-efab-4e9b-b575-92ae488dbbf8 None None] Enqueued Resource ID: 077ec5dd-ec4d-4e42-9b14-2d7176a1f7a0 with Priority: HIGHEST for action port [ 595.106097] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 077ec5dd-ec4d-4e42-9b14-2d7176a1f7a0 with Priority: HIGHEST for action port [ 595.106411] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-077ec5dd-ec4d-4e42-9b14-2d7176a1f7a0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.106538] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-077ec5dd-ec4d-4e42-9b14-2d7176a1f7a0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.106662] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-077ec5dd-ec4d-4e42-9b14-2d7176a1f7a0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.106945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-077ec5dd-ec4d-4e42-9b14-2d7176a1f7a0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.106945] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('077ec5dd-ec4d-4e42-9b14-2d7176a1f7a0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.152156] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6309188d-3f53-4dd2-b185-6544199024ad [ 595.152345] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.152682] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.152682] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.152808] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.152849] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.152932] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6309188d-3f53-4dd2-b185-6544199024ad already deleted. [ 595.153020] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6309188d-3f53-4dd2-b185-6544199024ad" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.609106] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 077ec5dd-ec4d-4e42-9b14-2d7176a1f7a0 [ 595.609524] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.609524] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.609695] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.609770] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.609859] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.609954] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:077ec5dd-ec4d-4e42-9b14-2d7176a1f7a0 already deleted. [ 595.610046] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-077ec5dd-ec4d-4e42-9b14-2d7176a1f7a0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.964928] env[65322]: INFO networking_nsxv3.common.synchronization [None req-efa0dc6f-ccd8-4295-af79-b5d6d6fe8cad None None] Enqueued Resource ID: fd568c52-4ab7-4c11-b76a-3d295d442d5d with Priority: HIGHEST for action port [ 595.965552] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd568c52-4ab7-4c11-b76a-3d295d442d5d with Priority: HIGHEST for action port [ 595.965947] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd568c52-4ab7-4c11-b76a-3d295d442d5d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.966122] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd568c52-4ab7-4c11-b76a-3d295d442d5d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.966688] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd568c52-4ab7-4c11-b76a-3d295d442d5d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.966688] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd568c52-4ab7-4c11-b76a-3d295d442d5d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.967320] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd568c52-4ab7-4c11-b76a-3d295d442d5d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.471673] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd568c52-4ab7-4c11-b76a-3d295d442d5d [ 596.471941] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.472100] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.472170] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.472378] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.472478] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.472558] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd568c52-4ab7-4c11-b76a-3d295d442d5d already deleted. [ 596.473572] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd568c52-4ab7-4c11-b76a-3d295d442d5d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.649535] env[65322]: INFO networking_nsxv3.common.synchronization [None req-07c14157-678e-4401-aead-275ec395149a None None] Enqueued Resource ID: 2282301f-0586-4c3d-b806-253d658e128c with Priority: HIGHEST for action port [ 596.649938] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2282301f-0586-4c3d-b806-253d658e128c with Priority: HIGHEST for action port [ 596.650253] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-2282301f-0586-4c3d-b806-253d658e128c taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.650365] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2282301f-0586-4c3d-b806-253d658e128c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.650435] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2282301f-0586-4c3d-b806-253d658e128c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.650713] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2282301f-0586-4c3d-b806-253d658e128c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.650792] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2282301f-0586-4c3d-b806-253d658e128c',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.154784] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2282301f-0586-4c3d-b806-253d658e128c [ 597.154784] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.154784] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.154784] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.154784] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.154784] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.154784] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2282301f-0586-4c3d-b806-253d658e128c already deleted. [ 597.154784] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2282301f-0586-4c3d-b806-253d658e128c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.031065] env[65322]: INFO networking_nsxv3.common.synchronization [None req-7978cab7-cef2-4a4e-ad98-328e5f1e5da8 None None] Enqueued Resource ID: 24554521-f70e-4b6d-82a7-449917310d98 with Priority: HIGHEST for action port [ 598.031518] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24554521-f70e-4b6d-82a7-449917310d98 with Priority: HIGHEST for action port [ 598.031845] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-24554521-f70e-4b6d-82a7-449917310d98 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.031986] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24554521-f70e-4b6d-82a7-449917310d98" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.032175] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24554521-f70e-4b6d-82a7-449917310d98" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.032568] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24554521-f70e-4b6d-82a7-449917310d98" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.032615] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24554521-f70e-4b6d-82a7-449917310d98',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.538420] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 24554521-f70e-4b6d-82a7-449917310d98 [ 598.538730] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.538901] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.538985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.539203] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.539297] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.539394] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:24554521-f70e-4b6d-82a7-449917310d98 already deleted. [ 598.539480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24554521-f70e-4b6d-82a7-449917310d98" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.796472] env[65322]: INFO networking_nsxv3.common.synchronization [None req-d4889204-6ceb-4a4b-9d15-87a13ee5ea31 None None] Enqueued Resource ID: a247ad3e-d2a4-4f34-a626-e47096e6b936 with Priority: HIGHEST for action port [ 599.796837] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a247ad3e-d2a4-4f34-a626-e47096e6b936 with Priority: HIGHEST for action port [ 599.797245] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-a247ad3e-d2a4-4f34-a626-e47096e6b936 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.797363] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a247ad3e-d2a4-4f34-a626-e47096e6b936" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.797363] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a247ad3e-d2a4-4f34-a626-e47096e6b936" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.797587] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a247ad3e-d2a4-4f34-a626-e47096e6b936" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.797672] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a247ad3e-d2a4-4f34-a626-e47096e6b936',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.177157] env[65322]: INFO networking_nsxv3.common.synchronization [req-fb4a0f19-e8ac-44d3-ac05-13d31923db35 req-83b8cd83-2ec5-4e21-b21f-82faa586da2a tempest-ImagesNegativeTestJSON-141942587 tempest-ImagesNegativeTestJSON-141942587-project-member] Enqueued Resource ID: 0300d669-cfda-4a93-9701-2092bc2115c1 with Priority: HIGHEST for action security_group_members [ 600.178207] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0300d669-cfda-4a93-9701-2092bc2115c1 with Priority: HIGHEST for action security_group_members [ 600.178207] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-0300d669-cfda-4a93-9701-2092bc2115c1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.178207] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.178207] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.182891] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.183086] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.183197] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.183260] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.183430] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.184617] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.184617] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0300d669-cfda-4a93-9701-2092bc2115c1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.299784] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a247ad3e-d2a4-4f34-a626-e47096e6b936 [ 600.300071] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.300186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.300311] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.300457] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.300541] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.300664] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a247ad3e-d2a4-4f34-a626-e47096e6b936 already deleted. [ 600.300744] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a247ad3e-d2a4-4f34-a626-e47096e6b936" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.687421] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.687421] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.687421] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.687421] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.687421] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.687421] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.687801] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.687801] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.687801] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.687801] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.687801] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0300d669-cfda-4a93-9701-2092bc2115c1 already deleted. [ 600.687938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.164379] env[65322]: INFO networking_nsxv3.common.synchronization [None req-30f7fe39-e435-4a6b-9283-ed9d348fed59 None None] Enqueued Resource ID: b4d89cf2-9aba-46c0-acad-24fef23d4332 with Priority: HIGHEST for action port [ 601.164775] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4d89cf2-9aba-46c0-acad-24fef23d4332 with Priority: HIGHEST for action port [ 601.165274] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4d89cf2-9aba-46c0-acad-24fef23d4332 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.165342] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4d89cf2-9aba-46c0-acad-24fef23d4332" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.165379] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4d89cf2-9aba-46c0-acad-24fef23d4332" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.165612] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4d89cf2-9aba-46c0-acad-24fef23d4332" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.165698] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4d89cf2-9aba-46c0-acad-24fef23d4332',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.668548] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b4d89cf2-9aba-46c0-acad-24fef23d4332 [ 601.668784] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.668920] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.668998] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.671038] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.671038] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.671038] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b4d89cf2-9aba-46c0-acad-24fef23d4332 already deleted. [ 601.671038] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4d89cf2-9aba-46c0-acad-24fef23d4332" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.963244] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-987 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.963445] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-987" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.964024] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-987" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.964024] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-987" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.964328] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.964659] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.964839] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.965111] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.965326] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.965715] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.966055] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 601.966183] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 601.967211] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 601.967211] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.967211] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 601.967211] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 601.987853] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 601.988033] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 601.988182] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 601.988333] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-987" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.988638] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-336f1b30-dbc8-40eb-9c14-9b41aa7280ff taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.988803] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-336f1b30-dbc8-40eb-9c14-9b41aa7280ff" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.988914] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-336f1b30-dbc8-40eb-9c14-9b41aa7280ff" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.989312] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-336f1b30-dbc8-40eb-9c14-9b41aa7280ff" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.989408] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('336f1b30-dbc8-40eb-9c14-9b41aa7280ff',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.136521] env[65322]: INFO networking_nsxv3.common.synchronization [None req-70e08e0d-13ab-4829-bdbe-1fa6879888fb None None] Enqueued Resource ID: 201327a0-f7d0-4f61-8d41-74dd4f0a4d35 with Priority: HIGHEST for action port [ 602.137097] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 201327a0-f7d0-4f61-8d41-74dd4f0a4d35 with Priority: HIGHEST for action port [ 602.137445] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-201327a0-f7d0-4f61-8d41-74dd4f0a4d35 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.137573] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-201327a0-f7d0-4f61-8d41-74dd4f0a4d35" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.137640] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-201327a0-f7d0-4f61-8d41-74dd4f0a4d35" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.137883] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-201327a0-f7d0-4f61-8d41-74dd4f0a4d35" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.137963] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('201327a0-f7d0-4f61-8d41-74dd4f0a4d35',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.497013] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.497013] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.497013] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.497013] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.497488] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.497488] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 336f1b30-dbc8-40eb-9c14-9b41aa7280ff not found, creating... [ 602.497563] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.497723] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.497844] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.498206] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.498443] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.498849] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.498978] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.498978] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.500294] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.500439] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.500618] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 336f1b30-dbc8-40eb-9c14-9b41aa7280ff is going to be created. [ 602.536061] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.536061] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.536061] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.536226] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.537911] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.537911] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-336f1b30-dbc8-40eb-9c14-9b41aa7280ff" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.642699] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 201327a0-f7d0-4f61-8d41-74dd4f0a4d35 [ 602.642699] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.642699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.642699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.642699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.642699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.642699] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:201327a0-f7d0-4f61-8d41-74dd4f0a4d35 already deleted. [ 602.642699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-201327a0-f7d0-4f61-8d41-74dd4f0a4d35" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.553378] env[65322]: INFO networking_nsxv3.common.synchronization [req-fb4a0f19-e8ac-44d3-ac05-13d31923db35 req-49cc35d3-47d6-4777-9f60-7f80abddd171 service nova] Enqueued Resource ID: 0300d669-cfda-4a93-9701-2092bc2115c1 with Priority: HIGHEST for action security_group_rules [ 603.553636] env[65322]: INFO networking_nsxv3.common.synchronization [req-fb4a0f19-e8ac-44d3-ac05-13d31923db35 req-49cc35d3-47d6-4777-9f60-7f80abddd171 service nova] Enqueued Resource ID: 0300d669-cfda-4a93-9701-2092bc2115c1 with Priority: HIGHEST for action security_group_members [ 603.553681] env[65322]: INFO networking_nsxv3.common.synchronization [req-fb4a0f19-e8ac-44d3-ac05-13d31923db35 req-49cc35d3-47d6-4777-9f60-7f80abddd171 service nova] Enqueued Resource ID: 336f1b30-dbc8-40eb-9c14-9b41aa7280ff with Priority: HIGHEST for action port [ 603.555081] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0300d669-cfda-4a93-9701-2092bc2115c1 with Priority: HIGHEST for action security_group_rules [ 603.555081] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0300d669-cfda-4a93-9701-2092bc2115c1 with Priority: HIGHEST for action security_group_members [ 603.555081] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 336f1b30-dbc8-40eb-9c14-9b41aa7280ff with Priority: HIGHEST for action port [ 603.555293] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0300d669-cfda-4a93-9701-2092bc2115c1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.555415] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.555478] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.555758] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.556563] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0300d669-cfda-4a93-9701-2092bc2115c1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.557886] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-0300d669-cfda-4a93-9701-2092bc2115c1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.557886] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.557886] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.557886] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.557886] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.557886] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.557886] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.557886] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.557886] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.558370] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0300d669-cfda-4a93-9701-2092bc2115c1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.561770] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-336f1b30-dbc8-40eb-9c14-9b41aa7280ff taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.561884] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-336f1b30-dbc8-40eb-9c14-9b41aa7280ff" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.561949] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-336f1b30-dbc8-40eb-9c14-9b41aa7280ff" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.562125] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-336f1b30-dbc8-40eb-9c14-9b41aa7280ff" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.562200] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('336f1b30-dbc8-40eb-9c14-9b41aa7280ff',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.763544] env[65322]: INFO networking_nsxv3.common.synchronization [None req-cf0d47db-c942-4bc4-b909-f71ac768e771 None None] Enqueued Resource ID: b810ff36-bd4e-409f-8d16-a27c520350ce with Priority: HIGHEST for action port [ 603.763806] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b810ff36-bd4e-409f-8d16-a27c520350ce with Priority: HIGHEST for action port [ 603.764638] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-b810ff36-bd4e-409f-8d16-a27c520350ce taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.764759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b810ff36-bd4e-409f-8d16-a27c520350ce" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.764823] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b810ff36-bd4e-409f-8d16-a27c520350ce" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.765922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b810ff36-bd4e-409f-8d16-a27c520350ce" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.766514] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b810ff36-bd4e-409f-8d16-a27c520350ce',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.063605] env[65322]: INFO networking_nsxv3.common.synchronization [None req-fca92e4b-37c7-4c9c-bc1b-8e25b1fdcde8 None None] Enqueued Resource ID: c48e18e3-8821-4a9c-a7b2-cfc2f2bda534 with Priority: HIGHEST for action port [ 604.064354] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-0300d669-cfda-4a93-9701-2092bc2115c1 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.064488] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.064625] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c48e18e3-8821-4a9c-a7b2-cfc2f2bda534 with Priority: HIGHEST for action port [ 604.064912] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-c48e18e3-8821-4a9c-a7b2-cfc2f2bda534 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.065536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c48e18e3-8821-4a9c-a7b2-cfc2f2bda534" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.065536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c48e18e3-8821-4a9c-a7b2-cfc2f2bda534" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.065536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c48e18e3-8821-4a9c-a7b2-cfc2f2bda534" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.065536] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c48e18e3-8821-4a9c-a7b2-cfc2f2bda534',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.076878] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0300d669-cfda-4a93-9701-2092bc2115c1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.077647] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 336f1b30-dbc8-40eb-9c14-9b41aa7280ff with status ACTIVE [ 604.077891] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.078023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.078085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.078287] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.078371] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.078548] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.078671] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.078729] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.078871] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.078941] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.079133] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.079221] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.079277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.079410] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.079478] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.079558] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 336f1b30-dbc8-40eb-9c14-9b41aa7280ff is going to be updated. [ 604.108895] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.109057] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.109109] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.109622] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.109622] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.109622] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-336f1b30-dbc8-40eb-9c14-9b41aa7280ff" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.272780] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b810ff36-bd4e-409f-8d16-a27c520350ce [ 604.273132] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.273294] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.273365] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.273672] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.273775] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.273873] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b810ff36-bd4e-409f-8d16-a27c520350ce already deleted. [ 604.273973] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b810ff36-bd4e-409f-8d16-a27c520350ce" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.569625] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c48e18e3-8821-4a9c-a7b2-cfc2f2bda534 [ 604.570012] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.570543] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.570652] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.570841] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.570955] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.571084] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c48e18e3-8821-4a9c-a7b2-cfc2f2bda534 already deleted. [ 604.571143] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c48e18e3-8821-4a9c-a7b2-cfc2f2bda534" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.583988] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0300d669-cfda-4a93-9701-2092bc2115c1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.086465] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.086659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.088011] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.088011] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.088011] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.088011] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0300d669-cfda-4a93-9701-2092bc2115c1 is going to be created. [ 605.180164] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.180336] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.180376] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.180581] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.180786] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.197435] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0300d669-cfda-4a93-9701-2092bc2115c1 in Status: UNINITIALIZED for 2s [ 605.680061] env[65322]: INFO networking_nsxv3.common.synchronization [None req-3fab171e-0efd-46a3-b2e7-adb9cec5b911 tempest-VolumesAssistedSnapshotsTest-1934724153 tempest-VolumesAssistedSnapshotsTest-1934724153-project-member] Enqueued Resource ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 with Priority: HIGHEST for action security_group_rules [ 605.682365] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 with Priority: HIGHEST for action security_group_rules [ 605.685230] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b868ada-e2d6-41f0-b807-c024a41e03d9 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.685365] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.685435] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.685889] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.685987] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b868ada-e2d6-41f0-b807-c024a41e03d9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.687907] env[65322]: INFO networking_nsxv3.common.synchronization [None req-4c0fd629-5941-47a5-bc32-54c3a516d9e5 None None] Enqueued Resource ID: d495fa64-fdfc-447d-ba9f-b3ffb8b15168 with Priority: HIGHEST for action port [ 605.688538] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d495fa64-fdfc-447d-ba9f-b3ffb8b15168 with Priority: HIGHEST for action port [ 605.688921] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-d495fa64-fdfc-447d-ba9f-b3ffb8b15168 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.689059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d495fa64-fdfc-447d-ba9f-b3ffb8b15168" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.689125] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d495fa64-fdfc-447d-ba9f-b3ffb8b15168" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.689370] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d495fa64-fdfc-447d-ba9f-b3ffb8b15168" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.689449] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d495fa64-fdfc-447d-ba9f-b3ffb8b15168',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.868622] env[65322]: INFO networking_nsxv3.common.synchronization [None req-9c54d093-d7dd-4e0d-9804-170b6103cb13 tempest-VolumesAssistedSnapshotsTest-1934724153 tempest-VolumesAssistedSnapshotsTest-1934724153-project-member] Enqueued Resource ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 with Priority: HIGHEST for action security_group_rules [ 605.870982] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 with Priority: HIGHEST for action security_group_rules [ 605.870982] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b868ada-e2d6-41f0-b807-c024a41e03d9 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.870982] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.987155] env[65322]: INFO networking_nsxv3.common.synchronization [req-06edd91a-b16f-432a-9764-43e5624ced55 req-c39a77aa-f2dd-4160-8b7d-353a5612a34a tempest-SecurityGroupRulesNegativeTestJSON-1567833909 tempest-SecurityGroupRulesNegativeTestJSON-1567833909-project-member] Enqueued Resource ID: 9c385601-7872-4b82-9918-4581a99a65b8 with Priority: HIGHEST for action security_group_rules [ 605.987718] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c385601-7872-4b82-9918-4581a99a65b8 with Priority: HIGHEST for action security_group_rules [ 605.994909] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c385601-7872-4b82-9918-4581a99a65b8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.995172] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c385601-7872-4b82-9918-4581a99a65b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.995245] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c385601-7872-4b82-9918-4581a99a65b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.995543] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c385601-7872-4b82-9918-4581a99a65b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.995630] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c385601-7872-4b82-9918-4581a99a65b8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.193268] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d495fa64-fdfc-447d-ba9f-b3ffb8b15168 [ 606.193466] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.193602] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.193886] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.194074] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.194143] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.194254] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d495fa64-fdfc-447d-ba9f-b3ffb8b15168 already deleted. [ 606.194315] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d495fa64-fdfc-447d-ba9f-b3ffb8b15168" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.216624] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.216624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.216624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.216624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.216624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.216624] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 already deleted. [ 606.216624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.216854] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.217981] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.218117] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b868ada-e2d6-41f0-b807-c024a41e03d9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.520421] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.520609] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.520750] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.521012] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.521587] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.521587] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c385601-7872-4b82-9918-4581a99a65b8 already deleted. [ 606.521587] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c385601-7872-4b82-9918-4581a99a65b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.585210] env[65322]: INFO networking_nsxv3.common.synchronization [None req-3b1b4797-f53b-4c1e-b970-82b0db20fea5 None None] Enqueued Resource ID: b386cb59-3f3a-480a-8b2f-8c4a81624b85 with Priority: HIGHEST for action port [ 606.585771] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b386cb59-3f3a-480a-8b2f-8c4a81624b85 with Priority: HIGHEST for action port [ 606.586091] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-b386cb59-3f3a-480a-8b2f-8c4a81624b85 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.587440] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b386cb59-3f3a-480a-8b2f-8c4a81624b85" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.587440] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b386cb59-3f3a-480a-8b2f-8c4a81624b85" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.587440] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b386cb59-3f3a-480a-8b2f-8c4a81624b85" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.587440] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b386cb59-3f3a-480a-8b2f-8c4a81624b85',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.748536] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.748864] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.748864] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.749131] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.749243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.749348] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 already deleted. [ 606.749429] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.090269] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b386cb59-3f3a-480a-8b2f-8c4a81624b85 [ 607.090269] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.090269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.090269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.090269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.090269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.090269] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b386cb59-3f3a-480a-8b2f-8c4a81624b85 already deleted. [ 607.090269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b386cb59-3f3a-480a-8b2f-8c4a81624b85" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.212625] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0300d669-cfda-4a93-9701-2092bc2115c1 in Status: SUCCESS [ 607.212854] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.213451] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.213721] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.213917] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.214053] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.214119] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.214272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.214436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.214436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.214579] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0300d669-cfda-4a93-9701-2092bc2115c1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.617826] env[65322]: INFO networking_nsxv3.common.synchronization [None req-a304f880-0916-4b91-95e9-08daee28c16c None None] Enqueued Resource ID: 787c7986-0150-4cbf-989f-a61ec5de8a9a with Priority: HIGHEST for action port [ 607.618437] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 787c7986-0150-4cbf-989f-a61ec5de8a9a with Priority: HIGHEST for action port [ 607.618910] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-787c7986-0150-4cbf-989f-a61ec5de8a9a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.619190] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-787c7986-0150-4cbf-989f-a61ec5de8a9a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.619190] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-787c7986-0150-4cbf-989f-a61ec5de8a9a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.620675] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-787c7986-0150-4cbf-989f-a61ec5de8a9a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.620675] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('787c7986-0150-4cbf-989f-a61ec5de8a9a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.717537] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-0300d669-cfda-4a93-9701-2092bc2115c1 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.717734] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.717734] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.717954] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.718218] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.718218] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.718413] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.718838] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.718958] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.719117] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.719308] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-0300d669-cfda-4a93-9701-2092bc2115c1 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.719416] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.719546] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.719613] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.719746] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.720624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.720624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.720624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.720624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.720624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.720624] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0300d669-cfda-4a93-9701-2092bc2115c1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.785973] env[65322]: INFO networking_nsxv3.common.synchronization [None req-ea67cb46-c9f7-43d0-ae14-362c39b9e31c None None] Enqueued Resource ID: 544343d9-8611-4a0a-b381-756813f342cf with Priority: HIGHEST for action port [ 607.786394] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 544343d9-8611-4a0a-b381-756813f342cf with Priority: HIGHEST for action port [ 607.786859] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-544343d9-8611-4a0a-b381-756813f342cf taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.786992] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-544343d9-8611-4a0a-b381-756813f342cf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.787072] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-544343d9-8611-4a0a-b381-756813f342cf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.787311] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-544343d9-8611-4a0a-b381-756813f342cf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.787391] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('544343d9-8611-4a0a-b381-756813f342cf',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.122278] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 787c7986-0150-4cbf-989f-a61ec5de8a9a [ 608.123074] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.123074] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.123074] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.123268] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.123268] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.123392] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:787c7986-0150-4cbf-989f-a61ec5de8a9a already deleted. [ 608.123502] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-787c7986-0150-4cbf-989f-a61ec5de8a9a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.230378] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0300d669-cfda-4a93-9701-2092bc2115c1: rpc.has_security_group_logging(os_id): False [ 608.248547] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.248715] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.248780] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.248972] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.249074] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.249334] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.249424] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.249424] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.249554] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.249626] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.249808] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.249902] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.249962] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.250332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.250332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.250452] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.250540] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.250601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.250777] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.250848] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.250932] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0300d669-cfda-4a93-9701-2092bc2115c1 is going to be created. [ 608.293821] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 544343d9-8611-4a0a-b381-756813f342cf [ 608.293821] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.293821] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.293821] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.293821] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.293821] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.293821] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:544343d9-8611-4a0a-b381-756813f342cf already deleted. [ 608.293821] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-544343d9-8611-4a0a-b381-756813f342cf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.346194] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.346364] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.346472] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.346708] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.346892] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.365379] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0300d669-cfda-4a93-9701-2092bc2115c1 in Status: IN_PROGRESS for 2s [ 610.081139] env[65322]: INFO networking_nsxv3.common.synchronization [req-83d17b88-2dbf-4887-90ff-bdf3709d1204 req-8c4ac421-37e0-4216-bc50-9b70b8fa7305 tempest-ServerRescueTestJSON-780090650 tempest-ServerRescueTestJSON-780090650-project-member] Enqueued Resource ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e with Priority: HIGHEST for action security_group_members [ 610.081794] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e with Priority: HIGHEST for action security_group_members [ 610.081973] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.082118] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.082185] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.082443] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.082606] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.082700] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.082758] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.082903] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.082989] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.084630] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88219fc7-d04d-4a0f-88d0-399f8bd7ef8e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.243726] env[65322]: INFO networking_nsxv3.common.synchronization [None req-4c056766-6b99-4926-9ec3-e8d73c3fbb99 None None] Enqueued Resource ID: 688b501d-f927-4fe3-856b-b08e55543cf2 with Priority: HIGHEST for action port [ 610.243992] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 688b501d-f927-4fe3-856b-b08e55543cf2 with Priority: HIGHEST for action port [ 610.244631] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-688b501d-f927-4fe3-856b-b08e55543cf2 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.244631] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-688b501d-f927-4fe3-856b-b08e55543cf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.244750] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-688b501d-f927-4fe3-856b-b08e55543cf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.244954] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-688b501d-f927-4fe3-856b-b08e55543cf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.245118] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('688b501d-f927-4fe3-856b-b08e55543cf2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.384275] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0300d669-cfda-4a93-9701-2092bc2115c1 in Status: SUCCESS [ 610.384570] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.589440] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.589440] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.589440] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.589440] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.589440] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.589440] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.589440] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.589440] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.589805] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.589805] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.589805] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e already deleted. [ 610.589805] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.746969] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 688b501d-f927-4fe3-856b-b08e55543cf2 [ 610.747227] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.747390] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.747438] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.747636] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.747719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.747810] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:688b501d-f927-4fe3-856b-b08e55543cf2 already deleted. [ 610.747886] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-688b501d-f927-4fe3-856b-b08e55543cf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.860985] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-241 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.861270] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-241" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.861334] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-241" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.861970] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-241" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.861970] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.866131] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.866131] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.866131] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.866131] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.866131] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.866131] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 610.866131] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 610.866131] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 610.866131] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.866504] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 610.866504] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 610.888445] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 610.888594] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 610.889390] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 610.889390] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-241" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.889390] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-b8875e6c-027e-46ea-9edb-0a6528a15736 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.889756] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-b8875e6c-027e-46ea-9edb-0a6528a15736" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.889756] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-b8875e6c-027e-46ea-9edb-0a6528a15736" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.889896] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-b8875e6c-027e-46ea-9edb-0a6528a15736" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.890267] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8875e6c-027e-46ea-9edb-0a6528a15736',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.893737] env[65322]: INFO networking_nsxv3.common.synchronization [None req-ad96b498-fe64-46f1-9335-669142f3ceae None None] Enqueued Resource ID: ad143959-5af4-4991-a930-a4f2a2a54d21 with Priority: HIGHEST for action port [ 610.893981] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad143959-5af4-4991-a930-a4f2a2a54d21 with Priority: HIGHEST for action port [ 610.894532] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad143959-5af4-4991-a930-a4f2a2a54d21 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.894704] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad143959-5af4-4991-a930-a4f2a2a54d21" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.894704] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad143959-5af4-4991-a930-a4f2a2a54d21" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.894948] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad143959-5af4-4991-a930-a4f2a2a54d21" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.897188] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad143959-5af4-4991-a930-a4f2a2a54d21',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.393282] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.394955] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.394955] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.394955] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.394955] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.394955] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port b8875e6c-027e-46ea-9edb-0a6528a15736 not found, creating... [ 611.394955] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.394955] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.394955] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.394955] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.395309] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.395309] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.395460] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.395539] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.395732] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.395915] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.396095] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: b8875e6c-027e-46ea-9edb-0a6528a15736 is going to be created. [ 611.398702] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad143959-5af4-4991-a930-a4f2a2a54d21 [ 611.398887] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.399029] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.399100] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.399501] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.399501] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.399501] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad143959-5af4-4991-a930-a4f2a2a54d21 already deleted. [ 611.399501] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad143959-5af4-4991-a930-a4f2a2a54d21" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.421853] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.422119] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.422236] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.422497] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.422708] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.422923] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-b8875e6c-027e-46ea-9edb-0a6528a15736" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.646042] env[65322]: INFO networking_nsxv3.common.synchronization [req-61ee6230-d0e6-468b-9b31-4c3a803093f9 req-5f60fff2-9016-4151-846d-1b843d23f5b6 tempest-MigrationsAdminTest-1504175931 tempest-MigrationsAdminTest-1504175931-project-member] Enqueued Resource ID: 26df6822-523e-4c95-9d74-db0cddb065c0 with Priority: HIGHEST for action security_group_members [ 611.646727] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26df6822-523e-4c95-9d74-db0cddb065c0 with Priority: HIGHEST for action security_group_members [ 611.646809] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-26df6822-523e-4c95-9d74-db0cddb065c0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.646890] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.647127] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.648591] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.648591] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.648591] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.648733] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.648894] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.649027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.649167] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26df6822-523e-4c95-9d74-db0cddb065c0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.153570] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.153719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.153785] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.154018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.154106] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.154303] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.154401] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.154435] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.154588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.154654] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.154733] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26df6822-523e-4c95-9d74-db0cddb065c0 already deleted. [ 612.154892] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.165704] env[65322]: INFO networking_nsxv3.common.synchronization [req-83d17b88-2dbf-4887-90ff-bdf3709d1204 req-aac4141e-861e-409f-ab05-7c88695cd348 service nova] Enqueued Resource ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e with Priority: HIGHEST for action security_group_rules [ 612.165704] env[65322]: INFO networking_nsxv3.common.synchronization [req-83d17b88-2dbf-4887-90ff-bdf3709d1204 req-aac4141e-861e-409f-ab05-7c88695cd348 service nova] Enqueued Resource ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e with Priority: HIGHEST for action security_group_members [ 612.165704] env[65322]: INFO networking_nsxv3.common.synchronization [req-83d17b88-2dbf-4887-90ff-bdf3709d1204 req-aac4141e-861e-409f-ab05-7c88695cd348 service nova] Enqueued Resource ID: b8875e6c-027e-46ea-9edb-0a6528a15736 with Priority: HIGHEST for action port [ 612.169593] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e with Priority: HIGHEST for action security_group_rules [ 612.169742] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e with Priority: HIGHEST for action security_group_members [ 612.169842] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8875e6c-027e-46ea-9edb-0a6528a15736 with Priority: HIGHEST for action port [ 612.171623] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.171764] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.171764] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.172022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.172106] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88219fc7-d04d-4a0f-88d0-399f8bd7ef8e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.172957] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.173114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.173180] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.173353] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.173494] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.173588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.173672] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.173820] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.173904] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.177295] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88219fc7-d04d-4a0f-88d0-399f8bd7ef8e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.181099] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8875e6c-027e-46ea-9edb-0a6528a15736 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.181099] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8875e6c-027e-46ea-9edb-0a6528a15736" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.181099] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8875e6c-027e-46ea-9edb-0a6528a15736" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.181099] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8875e6c-027e-46ea-9edb-0a6528a15736" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.181099] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8875e6c-027e-46ea-9edb-0a6528a15736',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.298565] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-620 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.299372] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.299372] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.299372] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.300179] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.300179] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.300179] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.300179] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.303791] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.304027] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.304144] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 612.304250] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 612.304356] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 612.304459] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.304561] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 612.304694] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 612.323963] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 612.324189] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 612.324271] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 612.324447] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.324741] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-4a972742-787c-41a5-a2c9-f9070be2879a taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.324911] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-4a972742-787c-41a5-a2c9-f9070be2879a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.328019] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-4a972742-787c-41a5-a2c9-f9070be2879a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.328019] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-4a972742-787c-41a5-a2c9-f9070be2879a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.328019] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a972742-787c-41a5-a2c9-f9070be2879a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.682223] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88219fc7-d04d-4a0f-88d0-399f8bd7ef8e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.683293] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.683463] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.685217] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8875e6c-027e-46ea-9edb-0a6528a15736 with status ACTIVE [ 612.685866] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.685866] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.685866] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.685866] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.685866] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.686114] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.686114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.686191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.686304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.686374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.686547] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.686637] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.686687] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.686816] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.686883] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.686963] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8875e6c-027e-46ea-9edb-0a6528a15736 is going to be updated. [ 612.710286] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.710611] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.710836] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.711094] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.711237] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.711379] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8875e6c-027e-46ea-9edb-0a6528a15736" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.823124] env[65322]: INFO networking_nsxv3.common.synchronization [None req-fbf03123-5671-429c-b910-a8e88bb49740 None None] Enqueued Resource ID: 58d1e701-a107-4e93-b8a5-a0766fea7e71 with Priority: HIGHEST for action port [ 612.823624] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d1e701-a107-4e93-b8a5-a0766fea7e71 with Priority: HIGHEST for action port [ 612.823932] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-58d1e701-a107-4e93-b8a5-a0766fea7e71 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.824067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58d1e701-a107-4e93-b8a5-a0766fea7e71" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.824136] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58d1e701-a107-4e93-b8a5-a0766fea7e71" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.825713] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58d1e701-a107-4e93-b8a5-a0766fea7e71" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.826254] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58d1e701-a107-4e93-b8a5-a0766fea7e71',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.829048] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.829242] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.829757] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.830700] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.831229] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.831456] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 4a972742-787c-41a5-a2c9-f9070be2879a not found, creating... [ 612.835018] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.835018] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.835018] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.835018] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.835018] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.835018] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.835018] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.835018] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.835018] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.835018] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.835730] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 4a972742-787c-41a5-a2c9-f9070be2879a is going to be created. [ 612.858498] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.858731] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.858847] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.859695] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.859695] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.859695] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-4a972742-787c-41a5-a2c9-f9070be2879a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.184109] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88219fc7-d04d-4a0f-88d0-399f8bd7ef8e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.338278] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58d1e701-a107-4e93-b8a5-a0766fea7e71 [ 613.338643] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.338769] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.338769] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.339466] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.339466] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.339466] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58d1e701-a107-4e93-b8a5-a0766fea7e71 already deleted. [ 613.339466] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58d1e701-a107-4e93-b8a5-a0766fea7e71" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.643670] env[65322]: INFO networking_nsxv3.common.synchronization [req-61ee6230-d0e6-468b-9b31-4c3a803093f9 req-3877eec9-98e4-4fcf-bd57-92faa4f23cc9 service nova] Enqueued Resource ID: 26df6822-523e-4c95-9d74-db0cddb065c0 with Priority: HIGHEST for action security_group_rules [ 613.643888] env[65322]: INFO networking_nsxv3.common.synchronization [req-61ee6230-d0e6-468b-9b31-4c3a803093f9 req-3877eec9-98e4-4fcf-bd57-92faa4f23cc9 service nova] Enqueued Resource ID: 26df6822-523e-4c95-9d74-db0cddb065c0 with Priority: HIGHEST for action security_group_members [ 613.644033] env[65322]: INFO networking_nsxv3.common.synchronization [req-61ee6230-d0e6-468b-9b31-4c3a803093f9 req-3877eec9-98e4-4fcf-bd57-92faa4f23cc9 service nova] Enqueued Resource ID: 4a972742-787c-41a5-a2c9-f9070be2879a with Priority: HIGHEST for action port [ 613.644559] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26df6822-523e-4c95-9d74-db0cddb065c0 with Priority: HIGHEST for action security_group_rules [ 613.644760] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26df6822-523e-4c95-9d74-db0cddb065c0 with Priority: HIGHEST for action security_group_members [ 613.644854] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a972742-787c-41a5-a2c9-f9070be2879a with Priority: HIGHEST for action port [ 613.645105] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26df6822-523e-4c95-9d74-db0cddb065c0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.647990] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.648191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.648726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.648876] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26df6822-523e-4c95-9d74-db0cddb065c0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.650274] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-26df6822-523e-4c95-9d74-db0cddb065c0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.650396] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.650458] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.650651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.650993] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.653526] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.653526] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.653526] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.653526] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.653526] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26df6822-523e-4c95-9d74-db0cddb065c0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.654305] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a972742-787c-41a5-a2c9-f9070be2879a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.654305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a972742-787c-41a5-a2c9-f9070be2879a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.654305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a972742-787c-41a5-a2c9-f9070be2879a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.654305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a972742-787c-41a5-a2c9-f9070be2879a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.654305] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a972742-787c-41a5-a2c9-f9070be2879a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.688193] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.688193] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.688522] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.688522] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.688583] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.688687] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e is going to be created. [ 613.715131] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.715131] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.715298] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.716163] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.716163] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.727467] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e in Status: UNINITIALIZED for 2s [ 613.802289] env[65322]: INFO networking_nsxv3.common.synchronization [None req-a5778dcf-1962-42f0-9ef6-7ec5a8f21191 None None] Enqueued Resource ID: 549996cc-b3ca-4075-8c88-826d309e3807 with Priority: HIGHEST for action port [ 613.803146] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 549996cc-b3ca-4075-8c88-826d309e3807 with Priority: HIGHEST for action port [ 613.803146] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-549996cc-b3ca-4075-8c88-826d309e3807 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.803146] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-549996cc-b3ca-4075-8c88-826d309e3807" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.803146] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-549996cc-b3ca-4075-8c88-826d309e3807" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.803748] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-549996cc-b3ca-4075-8c88-826d309e3807" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.803909] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('549996cc-b3ca-4075-8c88-826d309e3807',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.061596] env[65322]: INFO networking_nsxv3.common.synchronization [req-c5fb2d2b-ed0d-4164-aa51-2636af4402e1 req-0ec231f5-0a8f-467f-99bf-4b7e803183eb tempest-FloatingIPsAssociationNegativeTestJSON-1237424454 tempest-FloatingIPsAssociationNegativeTestJSON-1237424454-project-member] Enqueued Resource ID: 9d816765-57fa-4e08-a1ce-762a921d5096 with Priority: HIGHEST for action security_group_members [ 614.062267] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d816765-57fa-4e08-a1ce-762a921d5096 with Priority: HIGHEST for action security_group_members [ 614.062603] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d816765-57fa-4e08-a1ce-762a921d5096 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.062732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.062799] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.063063] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.066256] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.066256] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.066256] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.066256] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.066256] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.066256] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d816765-57fa-4e08-a1ce-762a921d5096',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.159735] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-26df6822-523e-4c95-9d74-db0cddb065c0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.159735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.159735] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a972742-787c-41a5-a2c9-f9070be2879a with status ACTIVE [ 614.159735] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.159735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.159735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.159735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.159735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.159735] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.159735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.159735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.159735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.159735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.159735] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.160532] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.160532] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.160532] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.160532] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.160532] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a972742-787c-41a5-a2c9-f9070be2879a is going to be updated. [ 614.165234] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('26df6822-523e-4c95-9d74-db0cddb065c0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.187667] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.187667] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.187667] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.187667] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.187959] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.187959] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a972742-787c-41a5-a2c9-f9070be2879a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.306316] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 549996cc-b3ca-4075-8c88-826d309e3807 [ 614.307988] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.307988] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.307988] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.307988] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.307988] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.307988] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:549996cc-b3ca-4075-8c88-826d309e3807 already deleted. [ 614.307988] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-549996cc-b3ca-4075-8c88-826d309e3807" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.443717] env[65322]: INFO networking_nsxv3.common.synchronization [None req-e2ecfc96-a3ee-4ecb-bf11-688c8a036c80 None None] Enqueued Resource ID: bebb0320-344f-489e-a0bd-8c36d251120a with Priority: HIGHEST for action port [ 614.444338] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bebb0320-344f-489e-a0bd-8c36d251120a with Priority: HIGHEST for action port [ 614.444651] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-bebb0320-344f-489e-a0bd-8c36d251120a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.444775] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bebb0320-344f-489e-a0bd-8c36d251120a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.444842] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bebb0320-344f-489e-a0bd-8c36d251120a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.445108] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bebb0320-344f-489e-a0bd-8c36d251120a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.446193] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bebb0320-344f-489e-a0bd-8c36d251120a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.454396] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-991 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.454582] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-991" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.454700] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-991" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.455052] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-991" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.455315] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.455581] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.455581] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.455952] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.456117] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.456332] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.456536] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 614.456654] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 614.456752] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 614.456856] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.456953] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 614.457093] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 614.477827] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 614.477986] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 614.478129] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 614.478294] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-991" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.478679] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-96789e75-8e13-494d-83dc-94f347c0acdd taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.478837] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-96789e75-8e13-494d-83dc-94f347c0acdd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.478949] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-96789e75-8e13-494d-83dc-94f347c0acdd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.479297] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-96789e75-8e13-494d-83dc-94f347c0acdd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.479429] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96789e75-8e13-494d-83dc-94f347c0acdd',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.567558] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.568309] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.568309] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.568309] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.568309] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.568309] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.568513] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.568513] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.568581] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.568615] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.568768] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d816765-57fa-4e08-a1ce-762a921d5096 already deleted. [ 614.568862] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.665543] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('26df6822-523e-4c95-9d74-db0cddb065c0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.948599] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bebb0320-344f-489e-a0bd-8c36d251120a [ 614.948903] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.948973] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.949024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.949226] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.949341] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.949444] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bebb0320-344f-489e-a0bd-8c36d251120a already deleted. [ 614.949566] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bebb0320-344f-489e-a0bd-8c36d251120a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.984540] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.984540] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.984540] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.984540] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.984540] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.984540] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 96789e75-8e13-494d-83dc-94f347c0acdd not found, creating... [ 614.984540] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.984540] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.984540] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.984540] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.984540] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.985181] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.985181] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.985181] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.985181] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.986011] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.986200] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 96789e75-8e13-494d-83dc-94f347c0acdd is going to be created. [ 615.009888] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.010192] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.010317] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.010513] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.010730] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.011046] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-96789e75-8e13-494d-83dc-94f347c0acdd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.169425] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.169425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.169425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.169425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.169425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.169425] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26df6822-523e-4c95-9d74-db0cddb065c0 is going to be created. [ 615.205114] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.205310] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.205351] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.205552] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.205711] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.226594] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26df6822-523e-4c95-9d74-db0cddb065c0 in Status: UNINITIALIZED for 2s [ 615.718203] env[65322]: INFO networking_nsxv3.common.synchronization [req-c5fb2d2b-ed0d-4164-aa51-2636af4402e1 req-27898de7-2712-4631-9677-b406cbdb9867 service nova] Enqueued Resource ID: 9d816765-57fa-4e08-a1ce-762a921d5096 with Priority: HIGHEST for action security_group_rules [ 615.718203] env[65322]: INFO networking_nsxv3.common.synchronization [req-c5fb2d2b-ed0d-4164-aa51-2636af4402e1 req-27898de7-2712-4631-9677-b406cbdb9867 service nova] Enqueued Resource ID: 9d816765-57fa-4e08-a1ce-762a921d5096 with Priority: HIGHEST for action security_group_members [ 615.718203] env[65322]: INFO networking_nsxv3.common.synchronization [req-c5fb2d2b-ed0d-4164-aa51-2636af4402e1 req-27898de7-2712-4631-9677-b406cbdb9867 service nova] Enqueued Resource ID: 96789e75-8e13-494d-83dc-94f347c0acdd with Priority: HIGHEST for action port [ 615.718636] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d816765-57fa-4e08-a1ce-762a921d5096 with Priority: HIGHEST for action security_group_rules [ 615.718636] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d816765-57fa-4e08-a1ce-762a921d5096 with Priority: HIGHEST for action security_group_members [ 615.718731] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96789e75-8e13-494d-83dc-94f347c0acdd with Priority: HIGHEST for action port [ 615.720565] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d816765-57fa-4e08-a1ce-762a921d5096 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.720565] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.720565] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.720565] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.720565] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d816765-57fa-4e08-a1ce-762a921d5096',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.721178] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d816765-57fa-4e08-a1ce-762a921d5096 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.722016] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.722016] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.722896] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.726302] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.726302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.726302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.726302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.726302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.726302] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d816765-57fa-4e08-a1ce-762a921d5096',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.726302] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-96789e75-8e13-494d-83dc-94f347c0acdd taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.726302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96789e75-8e13-494d-83dc-94f347c0acdd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.726302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96789e75-8e13-494d-83dc-94f347c0acdd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.726302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96789e75-8e13-494d-83dc-94f347c0acdd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.726302] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96789e75-8e13-494d-83dc-94f347c0acdd',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.740426] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e in Status: SUCCESS [ 615.741209] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.743173] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.743569] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.744681] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.744681] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.744681] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.744681] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.744681] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.745392] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.746035] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88219fc7-d04d-4a0f-88d0-399f8bd7ef8e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.771225] env[65322]: INFO networking_nsxv3.common.synchronization [req-e40e621a-144f-4df0-a242-0f5ba8e8fe42 req-94ebacee-02bc-4f3d-8b36-c10048c4b925 tempest-ImagesTestJSON-2080608290 tempest-ImagesTestJSON-2080608290-project-member] Enqueued Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 615.772497] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 615.772799] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.772921] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.772987] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.773265] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.773576] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.773576] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.773576] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.773731] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.773812] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.773910] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.136840] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-564 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.136840] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-564" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.136840] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-564" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.136840] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-564" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.138474] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.138474] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.138474] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.138474] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.138474] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.139021] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.142048] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 616.142048] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 616.142048] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 616.142048] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.142048] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 616.142048] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 616.161875] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 616.161875] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 616.161875] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 616.161875] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-564" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.161875] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-78590ca5-0087-454c-b2d6-0aa0865c9747 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.161875] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-78590ca5-0087-454c-b2d6-0aa0865c9747" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.161875] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-78590ca5-0087-454c-b2d6-0aa0865c9747" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.161875] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-78590ca5-0087-454c-b2d6-0aa0865c9747" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.161875] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78590ca5-0087-454c-b2d6-0aa0865c9747',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.229895] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d816765-57fa-4e08-a1ce-762a921d5096 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.229895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.229895] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96789e75-8e13-494d-83dc-94f347c0acdd with status ACTIVE [ 616.229895] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.229895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.229895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.229895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.229895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.229895] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.229895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.229895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.229895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.229895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.229895] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.230797] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.230797] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.232575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.232575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.232575] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96789e75-8e13-494d-83dc-94f347c0acdd is going to be updated. [ 616.234542] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d816765-57fa-4e08-a1ce-762a921d5096',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.248879] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.249029] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.249146] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.249466] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.249732] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.249908] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.250094] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.251903] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.251903] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.251903] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.251903] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.251903] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.251903] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.251903] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.251903] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.251903] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.251903] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.252464] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.252464] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.252464] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.253117] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88219fc7-d04d-4a0f-88d0-399f8bd7ef8e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.261011] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.261226] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.261344] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.261651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.261894] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.262132] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96789e75-8e13-494d-83dc-94f347c0acdd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.276454] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.277186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.277186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.277186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.277360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.277542] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.277711] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.277810] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.278079] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.278207] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.278342] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 already deleted. [ 616.278469] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.350678] env[65322]: INFO networking_nsxv3.common.synchronization [req-7b177714-dc01-4400-81cc-24f74009e655 req-cfb36e2e-0669-47e9-9368-8b6f830e86f0 tempest-SecurityGroupRulesNegativeTestJSON-1567833909 tempest-SecurityGroupRulesNegativeTestJSON-1567833909-project-member] Enqueued Resource ID: 9c385601-7872-4b82-9918-4581a99a65b8 with Priority: HIGHEST for action security_group_rules [ 616.350987] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c385601-7872-4b82-9918-4581a99a65b8 with Priority: HIGHEST for action security_group_rules [ 616.351721] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c385601-7872-4b82-9918-4581a99a65b8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.351891] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c385601-7872-4b82-9918-4581a99a65b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.352019] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c385601-7872-4b82-9918-4581a99a65b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.352258] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c385601-7872-4b82-9918-4581a99a65b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.352384] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c385601-7872-4b82-9918-4581a99a65b8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.664530] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.664707] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.664826] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.665117] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.665270] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.665418] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 78590ca5-0087-454c-b2d6-0aa0865c9747 not found, creating... [ 616.665662] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.665816] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.665930] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.666157] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.666284] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.666546] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.666688] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.666796] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.666990] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.667138] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.667269] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 78590ca5-0087-454c-b2d6-0aa0865c9747 is going to be created. [ 616.688504] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.688504] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.688504] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.689840] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.689840] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.689840] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-78590ca5-0087-454c-b2d6-0aa0865c9747" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.736965] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d816765-57fa-4e08-a1ce-762a921d5096',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.755341] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e: rpc.has_security_group_logging(os_id): False [ 616.774569] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.774778] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.774778] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.774990] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.775114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.775326] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.775439] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.775496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.775668] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.775743] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.775935] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.776040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.776096] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.776280] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.776357] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.776551] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.776642] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.776695] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.776830] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.776954] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.777027] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e is going to be created. [ 616.832025] env[65322]: INFO networking_nsxv3.common.synchronization [None req-b28c2cb0-53a9-4eee-a3cf-cbe5d90118ff None None] Enqueued Resource ID: 189306fa-b498-41ae-b725-f619672ef275 with Priority: HIGHEST for action port [ 616.832025] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 189306fa-b498-41ae-b725-f619672ef275 with Priority: HIGHEST for action port [ 616.832025] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-189306fa-b498-41ae-b725-f619672ef275 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.832025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-189306fa-b498-41ae-b725-f619672ef275" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.832025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-189306fa-b498-41ae-b725-f619672ef275" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.832025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-189306fa-b498-41ae-b725-f619672ef275" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.832523] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('189306fa-b498-41ae-b725-f619672ef275',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.860950] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.861208] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.861208] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.861859] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.861859] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.877120] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e in Status: IN_PROGRESS for 2s [ 616.888713] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.889120] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.889184] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.889406] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.889522] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.889627] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c385601-7872-4b82-9918-4581a99a65b8 already deleted. [ 616.889712] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c385601-7872-4b82-9918-4581a99a65b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.236793] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26df6822-523e-4c95-9d74-db0cddb065c0 in Status: SUCCESS [ 617.237189] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.237189] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.237366] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.237553] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.237670] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.237746] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.237865] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.237942] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.238024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.238117] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('26df6822-523e-4c95-9d74-db0cddb065c0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.239667] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.239827] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.239886] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.240019] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.240101] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.240189] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d816765-57fa-4e08-a1ce-762a921d5096 is going to be created. [ 617.265506] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.265687] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.265730] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.266410] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.266410] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.295914] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d816765-57fa-4e08-a1ce-762a921d5096 in Status: UNINITIALIZED for 2s [ 617.335135] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 189306fa-b498-41ae-b725-f619672ef275 [ 617.335372] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.335504] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.335576] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.335794] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.335908] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.336021] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:189306fa-b498-41ae-b725-f619672ef275 already deleted. [ 617.336110] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-189306fa-b498-41ae-b725-f619672ef275" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.430044] env[65322]: INFO networking_nsxv3.common.synchronization [req-e40e621a-144f-4df0-a242-0f5ba8e8fe42 req-ff5d16cd-22f5-41f9-aa9c-64488a08b576 service nova] Enqueued Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_rules [ 617.430307] env[65322]: INFO networking_nsxv3.common.synchronization [req-e40e621a-144f-4df0-a242-0f5ba8e8fe42 req-ff5d16cd-22f5-41f9-aa9c-64488a08b576 service nova] Enqueued Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 617.430369] env[65322]: INFO networking_nsxv3.common.synchronization [req-e40e621a-144f-4df0-a242-0f5ba8e8fe42 req-ff5d16cd-22f5-41f9-aa9c-64488a08b576 service nova] Enqueued Resource ID: 78590ca5-0087-454c-b2d6-0aa0865c9747 with Priority: HIGHEST for action port [ 617.430935] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_rules [ 617.431078] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 617.431170] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78590ca5-0087-454c-b2d6-0aa0865c9747 with Priority: HIGHEST for action port [ 617.431431] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.431547] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.431649] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.431922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.435239] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.436027] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.436128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.436128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.436405] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.436615] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.436746] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.436811] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.437157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.437157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.437384] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.441547] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-78590ca5-0087-454c-b2d6-0aa0865c9747 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.441693] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78590ca5-0087-454c-b2d6-0aa0865c9747" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.441792] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78590ca5-0087-454c-b2d6-0aa0865c9747" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.441962] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78590ca5-0087-454c-b2d6-0aa0865c9747" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.442055] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78590ca5-0087-454c-b2d6-0aa0865c9747',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.744128] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-26df6822-523e-4c95-9d74-db0cddb065c0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.744335] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.744410] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.744636] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.744820] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.744952] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.745035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.745205] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.745291] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.745377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.745528] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-26df6822-523e-4c95-9d74-db0cddb065c0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.745616] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.745675] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.745825] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.745977] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.746078] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.746134] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.746267] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.746338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.746443] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.746531] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('26df6822-523e-4c95-9d74-db0cddb065c0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.924941] env[65322]: INFO networking_nsxv3.common.synchronization [req-7574c33a-725d-48a5-8ac0-c5ba36583004 req-09555e63-d53a-4aee-9ed3-27dd400c26aa tempest-VolumesAdminNegativeTest-903707110 tempest-VolumesAdminNegativeTest-903707110-project-member] Enqueued Resource ID: 51992ebb-4768-42b5-9c53-db9beef2ee89 with Priority: HIGHEST for action security_group_members [ 617.928677] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51992ebb-4768-42b5-9c53-db9beef2ee89 with Priority: HIGHEST for action security_group_members [ 617.928677] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-51992ebb-4768-42b5-9c53-db9beef2ee89 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.928677] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.928677] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.928677] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.928677] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.928677] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.928677] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.928677] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.928677] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.928677] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51992ebb-4768-42b5-9c53-db9beef2ee89',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.945049] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.947745] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.947893] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.948325] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 78590ca5-0087-454c-b2d6-0aa0865c9747 with status ACTIVE [ 617.948510] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.948617] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.948682] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.948894] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.948985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.949168] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.949262] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.949323] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.949466] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.949541] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.949715] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.949801] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.950072] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.950072] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.951053] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.951173] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 78590ca5-0087-454c-b2d6-0aa0865c9747 is going to be updated. [ 617.978334] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.978334] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.978334] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.979825] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.979825] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.979825] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78590ca5-0087-454c-b2d6-0aa0865c9747" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.250043] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 26df6822-523e-4c95-9d74-db0cddb065c0: rpc.has_security_group_logging(os_id): False [ 618.272876] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.272876] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.272876] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.272876] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.272876] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.273530] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.273896] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.274128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.275063] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.275063] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.275756] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.276439] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.276439] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.276660] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.276855] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.277499] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.278982] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.278982] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.278982] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.278982] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.278982] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26df6822-523e-4c95-9d74-db0cddb065c0 is going to be created. [ 618.342778] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-149 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.343051] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-149" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.344117] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-149" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.344117] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-149" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.344117] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.344117] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.344418] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.344555] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.344699] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.344926] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.348024] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 618.348024] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 618.348024] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 618.348024] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.348024] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 618.348024] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 618.373154] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 618.373426] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 618.373672] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 618.373957] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-149" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.374366] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-8e9a38fc-dee3-4c51-88e7-a0ec8e532722 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.374658] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-8e9a38fc-dee3-4c51-88e7-a0ec8e532722" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.374812] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-8e9a38fc-dee3-4c51-88e7-a0ec8e532722" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.375173] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-8e9a38fc-dee3-4c51-88e7-a0ec8e532722" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.375402] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e9a38fc-dee3-4c51-88e7-a0ec8e532722',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.377272] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.377406] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.377474] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.377669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.377842] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.393025] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26df6822-523e-4c95-9d74-db0cddb065c0 in Status: IN_PROGRESS for 2s [ 618.434362] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.434442] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.434521] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.434689] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.434789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.434980] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.435096] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.435155] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.435303] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.435376] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.435460] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51992ebb-4768-42b5-9c53-db9beef2ee89 already deleted. [ 618.435537] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.449649] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.881887] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.882470] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.882638] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.882947] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.883420] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.883420] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 8e9a38fc-dee3-4c51-88e7-a0ec8e532722 not found, creating... [ 618.883569] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.883672] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.883762] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.884025] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.884402] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.884480] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.884586] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.884693] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.884899] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.885047] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.885213] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 8e9a38fc-dee3-4c51-88e7-a0ec8e532722 is going to be created. [ 618.890294] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e in Status: SUCCESS [ 618.890592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.913178] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.913468] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.913549] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.913834] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.914127] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.914385] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-8e9a38fc-dee3-4c51-88e7-a0ec8e532722" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.953392] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.953639] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.953639] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.953867] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.953938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.954039] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 is going to be created. [ 618.988335] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.988335] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.988335] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.988335] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.988775] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.003763] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: UNINITIALIZED for 2s [ 619.311434] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d816765-57fa-4e08-a1ce-762a921d5096 in Status: SUCCESS [ 619.311799] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.311892] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.312191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.312476] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.312631] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.312695] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.312934] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.312934] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.313042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.313142] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d816765-57fa-4e08-a1ce-762a921d5096',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.657812] env[65322]: INFO networking_nsxv3.common.synchronization [req-7574c33a-725d-48a5-8ac0-c5ba36583004 req-ee72aecd-0108-4783-9833-81b18a8a448c service nova] Enqueued Resource ID: 51992ebb-4768-42b5-9c53-db9beef2ee89 with Priority: HIGHEST for action security_group_rules [ 619.657812] env[65322]: INFO networking_nsxv3.common.synchronization [req-7574c33a-725d-48a5-8ac0-c5ba36583004 req-ee72aecd-0108-4783-9833-81b18a8a448c service nova] Enqueued Resource ID: 51992ebb-4768-42b5-9c53-db9beef2ee89 with Priority: HIGHEST for action security_group_members [ 619.657950] env[65322]: INFO networking_nsxv3.common.synchronization [req-7574c33a-725d-48a5-8ac0-c5ba36583004 req-ee72aecd-0108-4783-9833-81b18a8a448c service nova] Enqueued Resource ID: 8e9a38fc-dee3-4c51-88e7-a0ec8e532722 with Priority: HIGHEST for action port [ 619.658561] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51992ebb-4768-42b5-9c53-db9beef2ee89 with Priority: HIGHEST for action security_group_rules [ 619.658674] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51992ebb-4768-42b5-9c53-db9beef2ee89 with Priority: HIGHEST for action security_group_members [ 619.658775] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e9a38fc-dee3-4c51-88e7-a0ec8e532722 with Priority: HIGHEST for action port [ 619.659136] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51992ebb-4768-42b5-9c53-db9beef2ee89 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.659293] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.659446] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.659664] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.659762] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51992ebb-4768-42b5-9c53-db9beef2ee89',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.660786] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-51992ebb-4768-42b5-9c53-db9beef2ee89 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.661044] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.661114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.661409] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.661536] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.661631] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.661689] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.661891] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.661998] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.662116] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51992ebb-4768-42b5-9c53-db9beef2ee89',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.664932] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e9a38fc-dee3-4c51-88e7-a0ec8e532722 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.664932] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e9a38fc-dee3-4c51-88e7-a0ec8e532722" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.664932] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e9a38fc-dee3-4c51-88e7-a0ec8e532722" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.664932] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e9a38fc-dee3-4c51-88e7-a0ec8e532722" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.664932] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e9a38fc-dee3-4c51-88e7-a0ec8e532722',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.816540] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d816765-57fa-4e08-a1ce-762a921d5096 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.816771] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.816771] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.817142] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.817314] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.817427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.817484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.817658] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.817744] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.817851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.818015] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d816765-57fa-4e08-a1ce-762a921d5096 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.818125] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.818207] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.818299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.818465] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.818544] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.818669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.818786] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.818786] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.818876] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.818975] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d816765-57fa-4e08-a1ce-762a921d5096',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.094627] env[65322]: INFO networking_nsxv3.common.synchronization [None req-c9449a85-c207-4d0e-a89e-7fb33c349843 tempest-AttachInterfacesUnderV243Test-1887082716 tempest-AttachInterfacesUnderV243Test-1887082716-project-member] Enqueued Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGHEST for action security_group_rules [ 620.095250] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGHEST for action security_group_rules [ 620.095709] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02830029-f973-4892-9d06-f25f8aee730a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.095709] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.095709] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.097083] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.097083] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.165480] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-51992ebb-4768-42b5-9c53-db9beef2ee89 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.165480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.170360] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e9a38fc-dee3-4c51-88e7-a0ec8e532722 with status ACTIVE [ 620.170360] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.170360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.170360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.170360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.170360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.170360] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.170360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.170360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.170360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.170360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.170360] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.170360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.170360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.170360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.170360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.170360] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e9a38fc-dee3-4c51-88e7-a0ec8e532722 is going to be updated. [ 620.170938] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('51992ebb-4768-42b5-9c53-db9beef2ee89',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.201684] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.202565] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.202565] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.202707] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.202860] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.203108] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e9a38fc-dee3-4c51-88e7-a0ec8e532722" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.240094] env[65322]: INFO networking_nsxv3.common.synchronization [None req-63a1ac76-e044-4282-a1cb-036d7597476e tempest-AttachInterfacesUnderV243Test-1887082716 tempest-AttachInterfacesUnderV243Test-1887082716-project-member] Enqueued Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGHEST for action security_group_rules [ 620.240526] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGHEST for action security_group_rules [ 620.240803] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02830029-f973-4892-9d06-f25f8aee730a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.241376] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.327068] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d816765-57fa-4e08-a1ce-762a921d5096: rpc.has_security_group_logging(os_id): False [ 620.362708] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.362856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.362927] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.363170] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.363274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.366027] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.366027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.366027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.366027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.366027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.366272] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.366272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.366272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.366417] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.366448] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.367899] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.368037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.368108] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.368329] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.372026] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.372026] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d816765-57fa-4e08-a1ce-762a921d5096 is going to be created. [ 620.381293] env[65322]: INFO networking_nsxv3.common.synchronization [req-582eb44d-de27-4716-bcbc-7129d002b7f3 req-7551977d-6e04-449f-94bd-9f610c4081bc tempest-VolumesAssistedSnapshotsTest-1934724153 tempest-VolumesAssistedSnapshotsTest-1934724153-project-member] Enqueued Resource ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 with Priority: HIGHEST for action security_group_members [ 620.381878] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 with Priority: HIGHEST for action security_group_members [ 620.382198] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b868ada-e2d6-41f0-b807-c024a41e03d9 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.382321] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.382498] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.382661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.382793] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.382902] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.382962] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.383129] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.383225] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.383320] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b868ada-e2d6-41f0-b807-c024a41e03d9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.407467] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26df6822-523e-4c95-9d74-db0cddb065c0 in Status: SUCCESS [ 620.407753] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.450872] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.453018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.453018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.453018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.453018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.468166] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d816765-57fa-4e08-a1ce-762a921d5096 in Status: IN_PROGRESS for 2s [ 620.621952] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.622176] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.622272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.622540] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.622657] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.622770] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02830029-f973-4892-9d06-f25f8aee730a already deleted. [ 620.622884] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.623098] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.623315] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.623442] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.674296] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('51992ebb-4768-42b5-9c53-db9beef2ee89',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.888095] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.888454] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.888454] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.888823] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.888823] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.888958] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.888958] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.889102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.889170] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.889241] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.889317] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 already deleted. [ 620.889393] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.922431] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-60 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.922786] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-60" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.922786] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-60" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.923142] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-60" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.923292] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.923494] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.923585] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.923743] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.923878] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.924089] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.924198] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 620.924300] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 620.924400] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 620.924621] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.924621] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 620.924752] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 620.942099] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 620.942431] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 620.942431] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 620.942616] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-60" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.942860] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-e38f4d1a-914f-4b92-84c0-7d4bb7ee7049 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.943043] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-e38f4d1a-914f-4b92-84c0-7d4bb7ee7049" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.943143] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-e38f4d1a-914f-4b92-84c0-7d4bb7ee7049" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.943555] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-e38f4d1a-914f-4b92-84c0-7d4bb7ee7049" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.943630] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e38f4d1a-914f-4b92-84c0-7d4bb7ee7049',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.013684] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: SUCCESS [ 621.013938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.014110] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.014566] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.014566] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.014850] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.014850] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.014850] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.014997] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.015058] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.015135] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.063074] env[65322]: INFO networking_nsxv3.common.synchronization [req-c9f6a94f-874f-4eb9-917e-abad3cf55cef req-ce539d1a-842e-4274-82db-b78bcc955f96 tempest-ImagesNegativeTestJSON-141942587 tempest-ImagesNegativeTestJSON-141942587-project-member] Enqueued Resource ID: 0300d669-cfda-4a93-9701-2092bc2115c1 with Priority: HIGHEST for action security_group_members [ 621.063555] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0300d669-cfda-4a93-9701-2092bc2115c1 with Priority: HIGHEST for action security_group_members [ 621.063848] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-0300d669-cfda-4a93-9701-2092bc2115c1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.063967] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.064050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.064247] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.064391] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.064623] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.064623] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.064717] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.064753] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.064841] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0300d669-cfda-4a93-9701-2092bc2115c1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.144042] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.144199] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.144242] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.144452] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.144544] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.144636] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02830029-f973-4892-9d06-f25f8aee730a already deleted. [ 621.144714] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.176716] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.176887] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.176937] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.177137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.177243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.177342] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51992ebb-4768-42b5-9c53-db9beef2ee89 is going to be created. [ 621.200023] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.200198] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.200242] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.200475] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.201077] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.211183] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51992ebb-4768-42b5-9c53-db9beef2ee89 in Status: UNINITIALIZED for 2s [ 621.446528] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.446805] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.446850] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.447156] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.447342] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.447522] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port e38f4d1a-914f-4b92-84c0-7d4bb7ee7049 not found, creating... [ 621.447802] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.447987] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.448813] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.449116] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.449273] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.449552] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.449703] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.449814] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.450040] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.450171] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.450303] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: e38f4d1a-914f-4b92-84c0-7d4bb7ee7049 is going to be created. [ 621.471400] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.471589] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.471706] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.471976] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.472198] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.472410] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-e38f4d1a-914f-4b92-84c0-7d4bb7ee7049" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.518238] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.518407] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.518479] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.519087] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.519087] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.519087] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.519087] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.519366] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.519366] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.519366] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.519451] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.519531] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.519596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.519738] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.519872] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.519979] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.520026] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.520188] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.520266] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.520347] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.520805] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.567134] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.567299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.567393] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.567582] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.567668] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.567864] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.568067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.568067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.568221] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.568259] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.568482] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0300d669-cfda-4a93-9701-2092bc2115c1 is going to be updated. [ 621.654084] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.654374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.654374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.655406] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.655406] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.663592] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0300d669-cfda-4a93-9701-2092bc2115c1 in Status: IN_PROGRESS for 2s [ 622.025466] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16: rpc.has_security_group_logging(os_id): False [ 622.043613] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.044803] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.045116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.045358] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.045451] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.045681] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.045790] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.045853] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.046013] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.046099] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.046272] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.046364] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.046423] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.046560] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.046630] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.046810] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.046902] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.046961] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.049129] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.050477] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.050595] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 is going to be created. [ 622.198886] env[65322]: INFO networking_nsxv3.common.synchronization [req-582eb44d-de27-4716-bcbc-7129d002b7f3 req-2f9b157b-37ba-4e31-92dd-2e72bf52085b service nova] Enqueued Resource ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 with Priority: HIGHEST for action security_group_rules [ 622.199083] env[65322]: INFO networking_nsxv3.common.synchronization [req-582eb44d-de27-4716-bcbc-7129d002b7f3 req-2f9b157b-37ba-4e31-92dd-2e72bf52085b service nova] Enqueued Resource ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 with Priority: HIGHEST for action security_group_members [ 622.199214] env[65322]: INFO networking_nsxv3.common.synchronization [req-582eb44d-de27-4716-bcbc-7129d002b7f3 req-2f9b157b-37ba-4e31-92dd-2e72bf52085b service nova] Enqueued Resource ID: e38f4d1a-914f-4b92-84c0-7d4bb7ee7049 with Priority: HIGHEST for action port [ 622.199738] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 with Priority: HIGHEST for action security_group_rules [ 622.199869] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 with Priority: HIGHEST for action security_group_members [ 622.199964] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e38f4d1a-914f-4b92-84c0-7d4bb7ee7049 with Priority: HIGHEST for action port [ 622.200266] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b868ada-e2d6-41f0-b807-c024a41e03d9 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.200382] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.200446] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.200789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.202377] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b868ada-e2d6-41f0-b807-c024a41e03d9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.202377] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b868ada-e2d6-41f0-b807-c024a41e03d9 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.202377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.202377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.202377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.202661] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.202661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.202661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.202760] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.202911] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.203085] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b868ada-e2d6-41f0-b807-c024a41e03d9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.203780] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-e38f4d1a-914f-4b92-84c0-7d4bb7ee7049 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.203888] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e38f4d1a-914f-4b92-84c0-7d4bb7ee7049" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.203952] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e38f4d1a-914f-4b92-84c0-7d4bb7ee7049" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.204114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e38f4d1a-914f-4b92-84c0-7d4bb7ee7049" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.204180] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e38f4d1a-914f-4b92-84c0-7d4bb7ee7049',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.212266] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.212461] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.212519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.212700] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.212874] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.224347] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: IN_PROGRESS for 2s [ 622.484166] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d816765-57fa-4e08-a1ce-762a921d5096 in Status: SUCCESS [ 622.484518] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.705926] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3b868ada-e2d6-41f0-b807-c024a41e03d9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.707248] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b868ada-e2d6-41f0-b807-c024a41e03d9 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.707374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.707533] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e38f4d1a-914f-4b92-84c0-7d4bb7ee7049 with status ACTIVE [ 622.707784] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.707784] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.707927] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.708067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.708157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.708351] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.708575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.708575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.708668] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.708745] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.708980] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.710031] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.710417] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.710635] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.710751] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.710898] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e38f4d1a-914f-4b92-84c0-7d4bb7ee7049 is going to be updated. [ 622.729518] env[65322]: INFO networking_nsxv3.common.synchronization [req-80b5c0a3-c03f-46b4-92e4-2c78de1f26ba req-8cc4e715-a2bc-425b-8cf7-438000a969a4 tempest-AttachInterfacesV270Test-1350281496 tempest-AttachInterfacesV270Test-1350281496-project-member] Enqueued Resource ID: f508506d-1a05-435a-98ce-ae1f55ed3c92 with Priority: HIGHEST for action security_group_members [ 622.731036] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f508506d-1a05-435a-98ce-ae1f55ed3c92 with Priority: HIGHEST for action security_group_members [ 622.731499] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f508506d-1a05-435a-98ce-ae1f55ed3c92 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.731717] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.731884] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.732603] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.732871] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.733102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.733415] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.734081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.734238] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.734688] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f508506d-1a05-435a-98ce-ae1f55ed3c92',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.747583] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.748791] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.748791] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.748791] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.748791] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.748791] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e38f4d1a-914f-4b92-84c0-7d4bb7ee7049" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.216166] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3b868ada-e2d6-41f0-b807-c024a41e03d9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.224357] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51992ebb-4768-42b5-9c53-db9beef2ee89 in Status: SUCCESS [ 623.224701] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.224876] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.225118] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.225428] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.225720] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.225720] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.225844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.225923] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.226024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.226113] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('51992ebb-4768-42b5-9c53-db9beef2ee89',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.237338] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.237605] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.237696] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.237913] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.238054] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.238306] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.238442] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.238529] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.238781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.238871] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.238981] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f508506d-1a05-435a-98ce-ae1f55ed3c92 already deleted. [ 623.240383] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.318446] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-909 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.318446] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-909" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.318446] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-909" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.318446] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-909" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.318446] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.318446] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.318446] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.318446] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.318446] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.318446] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.318446] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 623.318446] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 623.318446] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 623.319257] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.319257] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 623.319257] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 623.347486] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.347486] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 623.347486] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.347486] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-909" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.348375] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-989f66ec-aa95-47f4-881b-f56844224902 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.349301] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-989f66ec-aa95-47f4-881b-f56844224902" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.352158] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-989f66ec-aa95-47f4-881b-f56844224902" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.352158] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-989f66ec-aa95-47f4-881b-f56844224902" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.352158] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('989f66ec-aa95-47f4-881b-f56844224902',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.676350] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0300d669-cfda-4a93-9701-2092bc2115c1 in Status: SUCCESS [ 623.676679] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0300d669-cfda-4a93-9701-2092bc2115c1 deletion is rescheduled due to dependency. [ 623.676679] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0300d669-cfda-4a93-9701-2092bc2115c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.719470] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.719657] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.719657] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.720164] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.720164] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.720164] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 is going to be created. [ 623.737359] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-51992ebb-4768-42b5-9c53-db9beef2ee89 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.738046] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.738046] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.738046] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.738046] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.738262] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.738262] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.738325] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.738404] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.738540] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.738790] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-51992ebb-4768-42b5-9c53-db9beef2ee89 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.739101] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.739171] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.739339] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.739498] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.739601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.739665] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.739813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.739894] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.740020] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.742533] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('51992ebb-4768-42b5-9c53-db9beef2ee89',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.755176] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.755176] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.755176] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.755375] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.757744] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.771056] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 in Status: UNINITIALIZED for 2s [ 623.858245] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.858245] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.858245] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.858245] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.858547] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.858627] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 989f66ec-aa95-47f4-881b-f56844224902 not found, creating... [ 623.859293] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.859293] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.859537] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.860267] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.860267] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.860382] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.860475] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.860605] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.862848] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.862848] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.862848] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 989f66ec-aa95-47f4-881b-f56844224902 is going to be created. [ 623.895832] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.895832] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.896116] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.896339] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.896691] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.896970] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-989f66ec-aa95-47f4-881b-f56844224902" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.241635] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: SUCCESS [ 624.241874] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.249490] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 51992ebb-4768-42b5-9c53-db9beef2ee89: rpc.has_security_group_logging(os_id): False [ 624.269031] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.269190] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.269263] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.269490] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.269564] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.269749] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.269846] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.269933] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.270067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.270146] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.270333] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.270429] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.270482] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.270621] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.270692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.270953] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.271072] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.271134] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.271277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.271353] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.271438] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51992ebb-4768-42b5-9c53-db9beef2ee89 is going to be created. [ 624.355647] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.355797] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.355865] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.356128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.356314] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.369951] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51992ebb-4768-42b5-9c53-db9beef2ee89 in Status: IN_PROGRESS for 2s [ 625.031035] env[65322]: INFO networking_nsxv3.common.synchronization [req-80b5c0a3-c03f-46b4-92e4-2c78de1f26ba req-386b46a8-fdd4-4390-83d5-bb772c2d35e0 service nova] Enqueued Resource ID: f508506d-1a05-435a-98ce-ae1f55ed3c92 with Priority: HIGHEST for action security_group_rules [ 625.031289] env[65322]: INFO networking_nsxv3.common.synchronization [req-80b5c0a3-c03f-46b4-92e4-2c78de1f26ba req-386b46a8-fdd4-4390-83d5-bb772c2d35e0 service nova] Enqueued Resource ID: f508506d-1a05-435a-98ce-ae1f55ed3c92 with Priority: HIGHEST for action security_group_members [ 625.031381] env[65322]: INFO networking_nsxv3.common.synchronization [req-80b5c0a3-c03f-46b4-92e4-2c78de1f26ba req-386b46a8-fdd4-4390-83d5-bb772c2d35e0 service nova] Enqueued Resource ID: 989f66ec-aa95-47f4-881b-f56844224902 with Priority: HIGHEST for action port [ 625.031976] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f508506d-1a05-435a-98ce-ae1f55ed3c92 with Priority: HIGHEST for action security_group_rules [ 625.032149] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f508506d-1a05-435a-98ce-ae1f55ed3c92 with Priority: HIGHEST for action security_group_members [ 625.032658] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 989f66ec-aa95-47f4-881b-f56844224902 with Priority: HIGHEST for action port [ 625.033101] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f508506d-1a05-435a-98ce-ae1f55ed3c92 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.033256] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.033394] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.033657] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.033729] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f508506d-1a05-435a-98ce-ae1f55ed3c92',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.034631] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f508506d-1a05-435a-98ce-ae1f55ed3c92 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.035656] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.035730] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.035919] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.036093] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.036200] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.036313] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.036483] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.036556] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.036652] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f508506d-1a05-435a-98ce-ae1f55ed3c92',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.037538] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-989f66ec-aa95-47f4-881b-f56844224902 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.037649] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-989f66ec-aa95-47f4-881b-f56844224902" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.037744] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-989f66ec-aa95-47f4-881b-f56844224902" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.037917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-989f66ec-aa95-47f4-881b-f56844224902" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.038027] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('989f66ec-aa95-47f4-881b-f56844224902',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.539667] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f508506d-1a05-435a-98ce-ae1f55ed3c92 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.539840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.543253] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 989f66ec-aa95-47f4-881b-f56844224902 with status ACTIVE [ 625.543464] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.543620] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.543684] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.545030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.545030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.545030] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.545030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.545030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.545030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.545030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.545030] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.545030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.545030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.545541] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.545541] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.545541] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 989f66ec-aa95-47f4-881b-f56844224902 is going to be updated. [ 625.546544] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f508506d-1a05-435a-98ce-ae1f55ed3c92',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.574454] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.575224] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.575224] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.575224] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.575224] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.575224] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-989f66ec-aa95-47f4-881b-f56844224902" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.787300] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 in Status: SUCCESS [ 625.787300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.787300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.787300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.787300] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.787300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.787300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.787300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.787300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.787300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.787300] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3b868ada-e2d6-41f0-b807-c024a41e03d9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.050782] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f508506d-1a05-435a-98ce-ae1f55ed3c92',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.289853] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3b868ada-e2d6-41f0-b807-c024a41e03d9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.384709] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 51992ebb-4768-42b5-9c53-db9beef2ee89 in Status: SUCCESS [ 626.384933] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.553844] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.554038] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.554109] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.554410] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.554529] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.554684] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f508506d-1a05-435a-98ce-ae1f55ed3c92 is going to be created. [ 626.581614] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.581843] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.581911] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.582204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.582546] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.592700] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f508506d-1a05-435a-98ce-ae1f55ed3c92 in Status: UNINITIALIZED for 2s [ 626.794632] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3b868ada-e2d6-41f0-b807-c024a41e03d9: rpc.has_security_group_logging(os_id): False [ 626.820438] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.820675] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.820794] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.821135] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.821229] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.821544] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.821752] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.821752] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.822668] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.822668] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.822668] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 is going to be created. [ 626.901455] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.902670] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.904972] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.904972] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.904972] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.919685] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 in Status: IN_PROGRESS for 2s [ 627.782258] env[65322]: INFO networking_nsxv3.common.synchronization [None req-ee18fabf-5774-4bc3-b7b0-59767c71a2a7 None None] Enqueued Resource ID: 9bf9e4e4-1a2d-4fa5-8b9b-6b57bc9fbaa6 with Priority: HIGHEST for action port [ 627.782926] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bf9e4e4-1a2d-4fa5-8b9b-6b57bc9fbaa6 with Priority: HIGHEST for action port [ 627.783332] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bf9e4e4-1a2d-4fa5-8b9b-6b57bc9fbaa6 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.787094] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bf9e4e4-1a2d-4fa5-8b9b-6b57bc9fbaa6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.787217] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bf9e4e4-1a2d-4fa5-8b9b-6b57bc9fbaa6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.787495] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bf9e4e4-1a2d-4fa5-8b9b-6b57bc9fbaa6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.787597] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bf9e4e4-1a2d-4fa5-8b9b-6b57bc9fbaa6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.291807] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9bf9e4e4-1a2d-4fa5-8b9b-6b57bc9fbaa6 [ 628.291807] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.291807] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.291807] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.292183] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.292183] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.292183] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9bf9e4e4-1a2d-4fa5-8b9b-6b57bc9fbaa6 already deleted. [ 628.292183] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bf9e4e4-1a2d-4fa5-8b9b-6b57bc9fbaa6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.593638] env[65322]: INFO networking_nsxv3.common.synchronization [None req-f49cd1a9-11a4-4f69-ad97-5935f567a353 tempest-ServersWithSpecificFlavorTestJSON-940507922 tempest-ServersWithSpecificFlavorTestJSON-940507922-project-member] Enqueued Resource ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 with Priority: HIGHEST for action security_group_rules [ 628.595852] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 with Priority: HIGHEST for action security_group_rules [ 628.596312] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-260ad733-0f5d-43fb-be04-c8ecbbbcea08 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.596525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.596646] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.596915] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.597010] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('260ad733-0f5d-43fb-be04-c8ecbbbcea08',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.606381] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f508506d-1a05-435a-98ce-ae1f55ed3c92 in Status: SUCCESS [ 628.606381] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.606511] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.606736] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.606930] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.607080] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.607208] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.607300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.607381] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.607504] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.607543] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f508506d-1a05-435a-98ce-ae1f55ed3c92',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.864752] env[65322]: INFO networking_nsxv3.common.synchronization [None req-7d232e76-18e3-4cc9-97f8-63dec135e309 tempest-ServersWithSpecificFlavorTestJSON-940507922 tempest-ServersWithSpecificFlavorTestJSON-940507922-project-member] Enqueued Resource ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 with Priority: HIGHEST for action security_group_rules [ 628.866018] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 with Priority: HIGHEST for action security_group_rules [ 628.866370] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-260ad733-0f5d-43fb-be04-c8ecbbbcea08 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.866652] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.934723] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 in Status: SUCCESS [ 628.935155] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.984024] env[65322]: INFO networking_nsxv3.common.synchronization [req-d18288d2-59d9-417a-a282-68716cf0551e req-eb104b39-109c-4534-8878-32128b4f1095 tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 628.984024] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 628.984024] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.984024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.984024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.984024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.984024] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.984714] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.984714] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.984714] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.984714] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.984848] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.110044] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f508506d-1a05-435a-98ce-ae1f55ed3c92 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.110270] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.112242] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.112242] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.112418] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.112418] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.112522] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.112615] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.112704] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.112792] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.112952] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f508506d-1a05-435a-98ce-ae1f55ed3c92 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.113060] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.113121] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.113297] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.113400] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.113490] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.113630] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.113786] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.113884] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.113971] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.114073] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f508506d-1a05-435a-98ce-ae1f55ed3c92',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.130820] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.131025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.131156] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.131324] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.131419] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.131519] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 already deleted. [ 629.131703] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.131767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.132074] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.132208] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('260ad733-0f5d-43fb-be04-c8ecbbbcea08',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.489240] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.489240] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.489240] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.489240] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.489240] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.489240] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.489240] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.489240] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.489240] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.489240] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.489240] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e65996f-05e7-4178-bdb9-30270bc56380 already deleted. [ 629.489240] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.599813] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-109 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.600009] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-109" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.600248] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-109" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.600600] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-109" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.600856] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.601137] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.601212] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.601401] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.601531] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.601725] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.601829] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 629.601932] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 629.602057] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 629.602160] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.602256] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 629.602381] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 629.616514] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f508506d-1a05-435a-98ce-ae1f55ed3c92: rpc.has_security_group_logging(os_id): False [ 629.637314] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 629.637605] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 629.637743] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 629.637842] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-109" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.638218] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-cb362e0c-042e-427b-afc6-6937ce9d7904 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.638418] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-cb362e0c-042e-427b-afc6-6937ce9d7904" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.638541] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-cb362e0c-042e-427b-afc6-6937ce9d7904" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.638921] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-cb362e0c-042e-427b-afc6-6937ce9d7904" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.639079] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb362e0c-042e-427b-afc6-6937ce9d7904',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.641915] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.642812] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.642812] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.642812] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.642812] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.642812] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.642812] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.642812] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.643731] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.643731] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.643731] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.643731] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.643731] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.643882] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.643882] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.644861] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.644861] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.644861] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.644861] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.644861] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.644861] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f508506d-1a05-435a-98ce-ae1f55ed3c92 is going to be created. [ 629.685098] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.685607] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.685607] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.686368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.686368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.686368] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 already deleted. [ 629.686368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.770772] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.771048] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.771132] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.771326] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.771530] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.791226] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f508506d-1a05-435a-98ce-ae1f55ed3c92 in Status: IN_PROGRESS for 2s [ 630.146780] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.147162] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.147360] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.147713] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.147891] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.148073] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port cb362e0c-042e-427b-afc6-6937ce9d7904 not found, creating... [ 630.148936] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.149175] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.149340] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.149681] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.149855] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.150333] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.150492] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.150657] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.150974] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.151178] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.151330] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: cb362e0c-042e-427b-afc6-6937ce9d7904 is going to be created. [ 630.179962] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.180269] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.180346] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.180817] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.181311] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.181757] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-cb362e0c-042e-427b-afc6-6937ce9d7904" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.472106] env[65322]: INFO networking_nsxv3.common.synchronization [None req-3ae8ef49-5535-4920-9f04-b6deb9ffeb81 None None] Enqueued Resource ID: f65d9423-dcd5-4323-9eab-bd773550ecba with Priority: HIGHEST for action port [ 630.472106] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f65d9423-dcd5-4323-9eab-bd773550ecba with Priority: HIGHEST for action port [ 630.472106] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-f65d9423-dcd5-4323-9eab-bd773550ecba taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.472106] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f65d9423-dcd5-4323-9eab-bd773550ecba" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.472106] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f65d9423-dcd5-4323-9eab-bd773550ecba" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.472718] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f65d9423-dcd5-4323-9eab-bd773550ecba" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.473202] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f65d9423-dcd5-4323-9eab-bd773550ecba',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.907099] env[65322]: INFO networking_nsxv3.common.synchronization [req-d18288d2-59d9-417a-a282-68716cf0551e req-07502fef-bd5a-4352-89f7-e00d1de98709 service nova] Enqueued Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_rules [ 630.907099] env[65322]: INFO networking_nsxv3.common.synchronization [req-d18288d2-59d9-417a-a282-68716cf0551e req-07502fef-bd5a-4352-89f7-e00d1de98709 service nova] Enqueued Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 630.907186] env[65322]: INFO networking_nsxv3.common.synchronization [req-d18288d2-59d9-417a-a282-68716cf0551e req-07502fef-bd5a-4352-89f7-e00d1de98709 service nova] Enqueued Resource ID: cb362e0c-042e-427b-afc6-6937ce9d7904 with Priority: HIGHEST for action port [ 630.907475] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_rules [ 630.907569] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 630.907684] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb362e0c-042e-427b-afc6-6937ce9d7904 with Priority: HIGHEST for action port [ 630.909288] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.909517] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.909788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.910050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.910314] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.911721] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.911778] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.911872] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.913249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.913249] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.913249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.913249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.913249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.913249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.913249] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.914152] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb362e0c-042e-427b-afc6-6937ce9d7904 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.914329] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb362e0c-042e-427b-afc6-6937ce9d7904" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.914571] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb362e0c-042e-427b-afc6-6937ce9d7904" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.914742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb362e0c-042e-427b-afc6-6937ce9d7904" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.914854] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb362e0c-042e-427b-afc6-6937ce9d7904',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.975022] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f65d9423-dcd5-4323-9eab-bd773550ecba [ 630.976069] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.976421] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.976421] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.977117] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.977117] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.977117] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f65d9423-dcd5-4323-9eab-bd773550ecba already deleted. [ 630.977117] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f65d9423-dcd5-4323-9eab-bd773550ecba" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.418923] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.419263] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.419263] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.420229] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb362e0c-042e-427b-afc6-6937ce9d7904 with status ACTIVE [ 631.420350] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.420665] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.420665] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.420796] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.420844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.421026] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.421138] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.421332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.421332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.421503] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.422205] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.422205] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.422205] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.422205] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.425393] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.425393] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb362e0c-042e-427b-afc6-6937ce9d7904 is going to be updated. [ 631.451849] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.452175] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.452392] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.452691] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.453582] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.453582] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb362e0c-042e-427b-afc6-6937ce9d7904" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.539860] env[65322]: INFO networking_nsxv3.common.synchronization [req-834d48f7-3931-4b71-afa8-8d119a2ba312 req-056c7013-3ce2-40cc-a677-eab1960229db tempest-ServerDiagnosticsNegativeTest-159621058 tempest-ServerDiagnosticsNegativeTest-159621058-project-member] Enqueued Resource ID: cf5d3fd5-a83d-454c-811a-c9b2e590ac47 with Priority: HIGHEST for action security_group_members [ 631.539860] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf5d3fd5-a83d-454c-811a-c9b2e590ac47 with Priority: HIGHEST for action security_group_members [ 631.539860] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.539860] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.539860] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.539860] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.541252] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.541252] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.541252] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.542032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.542114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.542487] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf5d3fd5-a83d-454c-811a-c9b2e590ac47',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.807649] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f508506d-1a05-435a-98ce-ae1f55ed3c92 in Status: SUCCESS [ 631.808138] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.928278] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.962301] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-620 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.962301] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.966257] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.966257] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.966257] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.966257] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.966257] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.966257] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.966257] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.966257] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.966257] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 631.966257] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 631.966257] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 631.966257] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.966257] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 631.966257] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 631.995047] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 631.995332] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 631.995551] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 631.995817] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.996255] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-0c6646a7-d339-4e07-8407-65aa5e06ea5d taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.997542] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-0c6646a7-d339-4e07-8407-65aa5e06ea5d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.997542] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-0c6646a7-d339-4e07-8407-65aa5e06ea5d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.997542] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-0c6646a7-d339-4e07-8407-65aa5e06ea5d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.997542] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c6646a7-d339-4e07-8407-65aa5e06ea5d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.045987] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.045987] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.045987] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.045987] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.045987] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.045987] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.045987] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.046399] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.046399] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.046399] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.046399] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf5d3fd5-a83d-454c-811a-c9b2e590ac47 already deleted. [ 632.046399] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.136152] env[65322]: INFO networking_nsxv3.common.synchronization [None req-c43c6129-0531-4f2d-96f6-af944d790e23 None None] Enqueued Resource ID: e48a6340-267e-4513-bc75-1d5783e202ac with Priority: HIGHEST for action port [ 632.136152] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e48a6340-267e-4513-bc75-1d5783e202ac with Priority: HIGHEST for action port [ 632.136152] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-e48a6340-267e-4513-bc75-1d5783e202ac taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.136152] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e48a6340-267e-4513-bc75-1d5783e202ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.136152] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e48a6340-267e-4513-bc75-1d5783e202ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.136152] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e48a6340-267e-4513-bc75-1d5783e202ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.136152] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e48a6340-267e-4513-bc75-1d5783e202ac',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.431845] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.432154] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.432154] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.432845] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.432845] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.432845] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e65996f-05e7-4178-bdb9-30270bc56380 is going to be created. [ 632.461202] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.461384] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.461453] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.461668] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.461836] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.476642] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: UNINITIALIZED for 2s [ 632.501424] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.501668] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.502891] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.502891] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.502891] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.502891] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 0c6646a7-d339-4e07-8407-65aa5e06ea5d not found, creating... [ 632.502891] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.502891] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.502891] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.503441] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.503441] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.503499] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.503714] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.503822] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.504311] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.504482] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.504621] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 0c6646a7-d339-4e07-8407-65aa5e06ea5d is going to be created. [ 632.532092] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.532828] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.532828] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.532828] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.533081] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.533273] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-0c6646a7-d339-4e07-8407-65aa5e06ea5d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.641117] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e48a6340-267e-4513-bc75-1d5783e202ac [ 632.641117] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.641117] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.641117] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.641117] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.641117] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.641117] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e48a6340-267e-4513-bc75-1d5783e202ac already deleted. [ 632.641117] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e48a6340-267e-4513-bc75-1d5783e202ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.356364] env[65322]: INFO networking_nsxv3.common.synchronization [req-834d48f7-3931-4b71-afa8-8d119a2ba312 req-20049fa0-ee26-4620-a49d-c9c71946fc28 service nova] Enqueued Resource ID: cf5d3fd5-a83d-454c-811a-c9b2e590ac47 with Priority: HIGHEST for action security_group_rules [ 633.356364] env[65322]: INFO networking_nsxv3.common.synchronization [req-834d48f7-3931-4b71-afa8-8d119a2ba312 req-20049fa0-ee26-4620-a49d-c9c71946fc28 service nova] Enqueued Resource ID: cf5d3fd5-a83d-454c-811a-c9b2e590ac47 with Priority: HIGHEST for action security_group_members [ 633.356364] env[65322]: INFO networking_nsxv3.common.synchronization [req-834d48f7-3931-4b71-afa8-8d119a2ba312 req-20049fa0-ee26-4620-a49d-c9c71946fc28 service nova] Enqueued Resource ID: 0c6646a7-d339-4e07-8407-65aa5e06ea5d with Priority: HIGHEST for action port [ 633.356364] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf5d3fd5-a83d-454c-811a-c9b2e590ac47 with Priority: HIGHEST for action security_group_rules [ 633.356598] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf5d3fd5-a83d-454c-811a-c9b2e590ac47 with Priority: HIGHEST for action security_group_members [ 633.356598] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c6646a7-d339-4e07-8407-65aa5e06ea5d with Priority: HIGHEST for action port [ 633.358091] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf5d3fd5-a83d-454c-811a-c9b2e590ac47 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.358091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.358091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.358091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.358429] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf5d3fd5-a83d-454c-811a-c9b2e590ac47',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.359842] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.359970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.360097] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.360329] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.360536] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.360695] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.361215] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.361215] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.361215] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.361215] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf5d3fd5-a83d-454c-811a-c9b2e590ac47',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.362496] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c6646a7-d339-4e07-8407-65aa5e06ea5d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.362496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c6646a7-d339-4e07-8407-65aa5e06ea5d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.362496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c6646a7-d339-4e07-8407-65aa5e06ea5d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.362684] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c6646a7-d339-4e07-8407-65aa5e06ea5d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.362763] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c6646a7-d339-4e07-8407-65aa5e06ea5d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.864836] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf5d3fd5-a83d-454c-811a-c9b2e590ac47',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.866061] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.866265] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.870752] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c6646a7-d339-4e07-8407-65aa5e06ea5d with status ACTIVE [ 633.870990] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.871310] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.871411] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.871622] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.871728] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.871931] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.872069] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.872132] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.872315] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.872412] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.872609] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.872726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.873384] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.873575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.873654] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.873755] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c6646a7-d339-4e07-8407-65aa5e06ea5d is going to be updated. [ 633.910015] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.910162] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.910162] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.910356] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.910458] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.910615] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c6646a7-d339-4e07-8407-65aa5e06ea5d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.004535] env[65322]: INFO networking_nsxv3.common.synchronization [req-c31b05bc-8afb-498a-8e7e-8007a09bf5e5 req-a5ee53de-b019-4e45-aa0d-c6dcdf36a8a2 tempest-AttachInterfacesUnderV243Test-1887082716 tempest-AttachInterfacesUnderV243Test-1887082716-project-member] Enqueued Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGHEST for action security_group_members [ 634.005530] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGHEST for action security_group_members [ 634.006222] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-02830029-f973-4892-9d06-f25f8aee730a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.006652] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.006912] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.007277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.007519] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.007702] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.007897] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.008209] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.008383] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.008556] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.367841] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf5d3fd5-a83d-454c-811a-c9b2e590ac47',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.491053] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: SUCCESS [ 634.491309] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.491486] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.491692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.491931] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.492109] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.492148] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.493934] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.493934] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.493934] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.493934] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.513069] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.514073] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.514073] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.514073] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.514073] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.514073] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.514073] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.514073] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.514073] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.514484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.514484] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02830029-f973-4892-9d06-f25f8aee730a already deleted. [ 634.514484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.551654] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-394 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.551897] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-394" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.551960] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-394" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.553744] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-394" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.553744] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.554286] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.555806] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.555806] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.555806] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.555806] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.556216] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 634.556216] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 634.556216] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 634.556216] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.556577] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 634.556577] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 634.594379] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 634.594534] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 634.594711] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 634.594890] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-394" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.595208] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-b09507a4-1ab2-4598-9f2c-e147be3587b1 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.595404] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-b09507a4-1ab2-4598-9f2c-e147be3587b1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.595828] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-b09507a4-1ab2-4598-9f2c-e147be3587b1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.595893] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-b09507a4-1ab2-4598-9f2c-e147be3587b1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.596018] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b09507a4-1ab2-4598-9f2c-e147be3587b1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.766856] env[65322]: INFO networking_nsxv3.common.synchronization [None req-4d5c968d-4e49-4905-8e92-17c7ac12251e None None] Enqueued Resource ID: 5dec47ca-70ed-4e62-a226-a94b475f23ba with Priority: HIGHEST for action port [ 634.767101] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dec47ca-70ed-4e62-a226-a94b475f23ba with Priority: HIGHEST for action port [ 634.767595] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-5dec47ca-70ed-4e62-a226-a94b475f23ba taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.767721] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5dec47ca-70ed-4e62-a226-a94b475f23ba" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.767791] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5dec47ca-70ed-4e62-a226-a94b475f23ba" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.768061] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5dec47ca-70ed-4e62-a226-a94b475f23ba" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.768143] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dec47ca-70ed-4e62-a226-a94b475f23ba',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.873303] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.873303] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.873303] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.873712] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.873712] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.873771] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf5d3fd5-a83d-454c-811a-c9b2e590ac47 is going to be created. [ 634.904246] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.904507] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.904507] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.904998] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.904998] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.917972] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf5d3fd5-a83d-454c-811a-c9b2e590ac47 in Status: UNINITIALIZED for 2s [ 634.997336] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.997493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.997664] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.997795] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.997959] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.998076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.998161] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.998328] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.998806] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.998806] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.998806] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.998806] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.998806] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.999270] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.999447] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.999564] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.999638] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.999801] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.999890] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.999975] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.000095] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.106927] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.106927] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.107108] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.107920] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.107920] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.107920] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port b09507a4-1ab2-4598-9f2c-e147be3587b1 not found, creating... [ 635.107920] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.108151] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.108151] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.108349] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.108550] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.110498] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.110498] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.110498] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.110498] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.110498] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.110498] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: b09507a4-1ab2-4598-9f2c-e147be3587b1 is going to be created. [ 635.138944] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.139180] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.139338] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.139646] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.140018] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.140100] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-b09507a4-1ab2-4598-9f2c-e147be3587b1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.273845] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5dec47ca-70ed-4e62-a226-a94b475f23ba [ 635.274134] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.274295] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.274368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.274593] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.274681] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.274775] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5dec47ca-70ed-4e62-a226-a94b475f23ba already deleted. [ 635.274855] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5dec47ca-70ed-4e62-a226-a94b475f23ba" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.502386] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e65996f-05e7-4178-bdb9-30270bc56380: rpc.has_security_group_logging(os_id): False [ 635.528880] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.528880] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.528880] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.528880] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.528880] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.528880] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.528880] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.528880] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.529290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.529290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.529347] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.529440] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.529531] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.529819] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.529819] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.529976] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.530082] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.530144] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.530284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.530356] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.530441] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e65996f-05e7-4178-bdb9-30270bc56380 is going to be created. [ 635.597331] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.597523] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.597587] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.597788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.598423] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.613187] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: IN_PROGRESS for 2s [ 635.929926] env[65322]: INFO networking_nsxv3.common.synchronization [req-c31b05bc-8afb-498a-8e7e-8007a09bf5e5 req-acdd7194-b297-4e7f-8d10-1dd5bc6fcde6 service nova] Enqueued Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGHEST for action security_group_rules [ 635.931189] env[65322]: INFO networking_nsxv3.common.synchronization [req-c31b05bc-8afb-498a-8e7e-8007a09bf5e5 req-acdd7194-b297-4e7f-8d10-1dd5bc6fcde6 service nova] Enqueued Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGHEST for action security_group_members [ 635.931189] env[65322]: INFO networking_nsxv3.common.synchronization [req-c31b05bc-8afb-498a-8e7e-8007a09bf5e5 req-acdd7194-b297-4e7f-8d10-1dd5bc6fcde6 service nova] Enqueued Resource ID: b09507a4-1ab2-4598-9f2c-e147be3587b1 with Priority: HIGHEST for action port [ 635.931189] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGHEST for action security_group_rules [ 635.931189] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGHEST for action security_group_members [ 635.931189] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b09507a4-1ab2-4598-9f2c-e147be3587b1 with Priority: HIGHEST for action port [ 635.931541] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02830029-f973-4892-9d06-f25f8aee730a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.931584] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.931620] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.931869] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.931902] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.933937] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-02830029-f973-4892-9d06-f25f8aee730a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.934085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.934133] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.934495] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.934495] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.934737] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.934796] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.935509] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.935509] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.935509] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.936628] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-b09507a4-1ab2-4598-9f2c-e147be3587b1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.936738] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b09507a4-1ab2-4598-9f2c-e147be3587b1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.936824] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b09507a4-1ab2-4598-9f2c-e147be3587b1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.937469] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b09507a4-1ab2-4598-9f2c-e147be3587b1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.937469] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b09507a4-1ab2-4598-9f2c-e147be3587b1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.434528] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-02830029-f973-4892-9d06-f25f8aee730a taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.434673] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.439505] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b09507a4-1ab2-4598-9f2c-e147be3587b1 with status ACTIVE [ 636.439505] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.439706] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.439747] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.442042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.442042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.442042] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.442042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.442042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.442042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.442042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.442042] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.442042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.442042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.442042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.442042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.442042] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b09507a4-1ab2-4598-9f2c-e147be3587b1 is going to be updated. [ 636.443191] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.471651] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.471651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.471651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.472019] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.472019] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.472019] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b09507a4-1ab2-4598-9f2c-e147be3587b1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.934408] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf5d3fd5-a83d-454c-811a-c9b2e590ac47 in Status: SUCCESS [ 636.934408] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.934408] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.934408] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.937080] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.937080] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.937080] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.937080] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.937080] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.937080] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.937080] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf5d3fd5-a83d-454c-811a-c9b2e590ac47',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.947521] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.440260] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.440557] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.440952] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.441110] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.441249] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.441483] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.441601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.441820] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.441975] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.442149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.442397] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.442560] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.442677] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.445753] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.446071] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.446261] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.446381] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.447252] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.447411] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.447584] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.447973] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf5d3fd5-a83d-454c-811a-c9b2e590ac47',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.450307] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.450891] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.450891] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.451087] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.451160] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.451310] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02830029-f973-4892-9d06-f25f8aee730a is going to be created. [ 637.483073] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.483186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.483258] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.483482] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.483672] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.499817] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02830029-f973-4892-9d06-f25f8aee730a in Status: UNINITIALIZED for 2s [ 637.516389] env[65322]: INFO networking_nsxv3.common.synchronization [req-c6877b00-525e-4c2c-a900-90930ea6b30a req-89354d52-a4a2-461c-bad7-455fad88130e tempest-InstanceActionsNegativeTestJSON-2101621013 tempest-InstanceActionsNegativeTestJSON-2101621013-project-member] Enqueued Resource ID: 6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 with Priority: HIGHEST for action security_group_members [ 637.516389] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 with Priority: HIGHEST for action security_group_members [ 637.516389] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.516389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.516389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.516389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.516389] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.516389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.516389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.516389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.516389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.516389] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e834e6a-77bf-4cd6-92bf-e7ad79ee2707',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.627097] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: SUCCESS [ 637.627498] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.954650] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf5d3fd5-a83d-454c-811a-c9b2e590ac47: rpc.has_security_group_logging(os_id): False [ 637.975052] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.975810] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.975965] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.976550] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.976711] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.976991] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.977354] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.977354] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.977456] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.977596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.977807] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.978426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.978426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.978426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.978602] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.978896] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.979094] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.979094] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.979418] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.979418] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.979418] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf5d3fd5-a83d-454c-811a-c9b2e590ac47 is going to be created. [ 638.020129] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.020432] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.020552] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.020926] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.021011] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.021323] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.021464] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.021577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.021801] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.021920] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.022020] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 already deleted. [ 638.022191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.055031] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.055261] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.055367] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.055574] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.055838] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.075096] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf5d3fd5-a83d-454c-811a-c9b2e590ac47 in Status: IN_PROGRESS for 2s [ 638.094697] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-752 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.094967] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-752" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.095126] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-752" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.095474] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-752" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.096599] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.097269] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.097269] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.097269] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.097490] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.097646] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.097758] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 638.097860] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 638.097960] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 638.098095] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 638.098204] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 638.098354] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 638.132270] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 638.132558] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 638.132712] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 638.133016] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-752" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.133426] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-390cc351-89bc-4ec5-8114-bbece63331eb taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.133654] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-390cc351-89bc-4ec5-8114-bbece63331eb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.133789] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-390cc351-89bc-4ec5-8114-bbece63331eb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.134248] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-390cc351-89bc-4ec5-8114-bbece63331eb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.134427] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('390cc351-89bc-4ec5-8114-bbece63331eb',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.640076] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.640076] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.640076] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.640076] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.640464] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.640464] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 390cc351-89bc-4ec5-8114-bbece63331eb not found, creating... [ 638.641115] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.641402] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.641507] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.641742] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.641895] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.642263] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.642492] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.642492] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.642718] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.642853] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.642977] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 390cc351-89bc-4ec5-8114-bbece63331eb is going to be created. [ 638.683184] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.683475] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.683679] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.683854] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.684087] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.684319] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-390cc351-89bc-4ec5-8114-bbece63331eb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.403034] env[65322]: INFO networking_nsxv3.common.synchronization [req-c6877b00-525e-4c2c-a900-90930ea6b30a req-2271da7b-ced1-4f60-97ca-57a420f5470b service nova] Enqueued Resource ID: 6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 with Priority: HIGHEST for action security_group_rules [ 639.403336] env[65322]: INFO networking_nsxv3.common.synchronization [req-c6877b00-525e-4c2c-a900-90930ea6b30a req-2271da7b-ced1-4f60-97ca-57a420f5470b service nova] Enqueued Resource ID: 6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 with Priority: HIGHEST for action security_group_members [ 639.403336] env[65322]: INFO networking_nsxv3.common.synchronization [req-c6877b00-525e-4c2c-a900-90930ea6b30a req-2271da7b-ced1-4f60-97ca-57a420f5470b service nova] Enqueued Resource ID: 390cc351-89bc-4ec5-8114-bbece63331eb with Priority: HIGHEST for action port [ 639.403850] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 with Priority: HIGHEST for action security_group_rules [ 639.403986] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 with Priority: HIGHEST for action security_group_members [ 639.404096] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 390cc351-89bc-4ec5-8114-bbece63331eb with Priority: HIGHEST for action port [ 639.404459] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.404578] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.404578] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.404830] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.404941] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e834e6a-77bf-4cd6-92bf-e7ad79ee2707',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.405761] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.405885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.405989] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.406179] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.406627] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.406627] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.406627] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.406627] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.406942] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.406942] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e834e6a-77bf-4cd6-92bf-e7ad79ee2707',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.407609] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-390cc351-89bc-4ec5-8114-bbece63331eb taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.407982] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-390cc351-89bc-4ec5-8114-bbece63331eb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.407982] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-390cc351-89bc-4ec5-8114-bbece63331eb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.407982] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-390cc351-89bc-4ec5-8114-bbece63331eb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.407982] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('390cc351-89bc-4ec5-8114-bbece63331eb',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.512095] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02830029-f973-4892-9d06-f25f8aee730a in Status: SUCCESS [ 639.513021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.513021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.513021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.513188] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.513188] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.513290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.513498] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.513583] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.513672] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.513759] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.910253] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e834e6a-77bf-4cd6-92bf-e7ad79ee2707',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.912917] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.912917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.912917] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 390cc351-89bc-4ec5-8114-bbece63331eb with status ACTIVE [ 639.912917] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.912917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.912917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.912917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.912917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.912917] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.912917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.912917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.912917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.912917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.912917] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.913697] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.913697] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.913697] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.913697] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.913697] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 390cc351-89bc-4ec5-8114-bbece63331eb is going to be updated. [ 639.944351] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.945649] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.945649] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.945649] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.945649] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.945649] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-390cc351-89bc-4ec5-8114-bbece63331eb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.017247] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.066369] env[65322]: INFO networking_nsxv3.common.synchronization [req-581fd9c7-ef8f-45e1-ac43-0dd10547d179 req-bced5c08-4679-4899-bc05-cc5b31e5163f tempest-ServersWithSpecificFlavorTestJSON-940507922 tempest-ServersWithSpecificFlavorTestJSON-940507922-project-member] Enqueued Resource ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 with Priority: HIGHEST for action security_group_members [ 640.066369] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 with Priority: HIGHEST for action security_group_members [ 640.066369] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-260ad733-0f5d-43fb-be04-c8ecbbbcea08 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.066369] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.066369] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.066369] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.066369] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.066369] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.066369] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.066369] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.066369] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.066816] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('260ad733-0f5d-43fb-be04-c8ecbbbcea08',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.094948] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf5d3fd5-a83d-454c-811a-c9b2e590ac47 in Status: SUCCESS [ 640.095221] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.416206] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e834e6a-77bf-4cd6-92bf-e7ad79ee2707',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.466218] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-483 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.466218] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-483" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.466218] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-483" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.466218] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-483" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.466218] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.466218] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.466218] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.466780] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.467035] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.467336] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.467603] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 640.467926] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 640.468167] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 640.468392] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.468598] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 640.468828] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 640.492052] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 640.492052] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 640.492052] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 640.492266] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-483" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.492520] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-d5bc6f93-685b-4d9c-bb32-6b25e1b25d30 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.492839] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-d5bc6f93-685b-4d9c-bb32-6b25e1b25d30" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.492955] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-d5bc6f93-685b-4d9c-bb32-6b25e1b25d30" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.493286] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-d5bc6f93-685b-4d9c-bb32-6b25e1b25d30" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.493424] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5bc6f93-685b-4d9c-bb32-6b25e1b25d30',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.520202] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02830029-f973-4892-9d06-f25f8aee730a: rpc.has_security_group_logging(os_id): False [ 640.542102] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.542102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.542102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.542102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.542102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.542102] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.542102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.542102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.542102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.542102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.542102] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02830029-f973-4892-9d06-f25f8aee730a is going to be created. [ 640.569158] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.569158] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.569158] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.569985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.569985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.569985] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.569985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.569985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.570166] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.570166] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.570225] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 already deleted. [ 640.570286] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.605229] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.605438] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.605533] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.605781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.605993] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.619440] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02830029-f973-4892-9d06-f25f8aee730a in Status: IN_PROGRESS for 2s [ 640.920958] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.921197] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.921278] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.921535] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.921641] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.921759] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 is going to be created. [ 640.946906] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.946906] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.946906] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.947369] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.948279] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.959391] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 in Status: UNINITIALIZED for 2s [ 640.997704] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.998008] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.998279] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.998595] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.998811] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.998972] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port d5bc6f93-685b-4d9c-bb32-6b25e1b25d30 not found, creating... [ 640.999411] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.999582] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.999701] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.999943] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.000150] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.000407] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.000572] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.000681] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.000885] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.001014] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.001252] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: d5bc6f93-685b-4d9c-bb32-6b25e1b25d30 is going to be created. [ 641.031297] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.031297] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.031297] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.031555] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.032631] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.032631] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-d5bc6f93-685b-4d9c-bb32-6b25e1b25d30" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.737166] env[65322]: INFO networking_nsxv3.common.synchronization [req-581fd9c7-ef8f-45e1-ac43-0dd10547d179 req-ddd8725a-9061-45e3-adec-8ce6efa52fa9 service nova] Enqueued Resource ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 with Priority: HIGHEST for action security_group_rules [ 641.737461] env[65322]: INFO networking_nsxv3.common.synchronization [req-581fd9c7-ef8f-45e1-ac43-0dd10547d179 req-ddd8725a-9061-45e3-adec-8ce6efa52fa9 service nova] Enqueued Resource ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 with Priority: HIGHEST for action security_group_members [ 641.737680] env[65322]: INFO networking_nsxv3.common.synchronization [req-581fd9c7-ef8f-45e1-ac43-0dd10547d179 req-ddd8725a-9061-45e3-adec-8ce6efa52fa9 service nova] Enqueued Resource ID: d5bc6f93-685b-4d9c-bb32-6b25e1b25d30 with Priority: HIGHEST for action port [ 641.738601] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 with Priority: HIGHEST for action security_group_rules [ 641.738805] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 with Priority: HIGHEST for action security_group_members [ 641.738975] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5bc6f93-685b-4d9c-bb32-6b25e1b25d30 with Priority: HIGHEST for action port [ 641.739394] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-260ad733-0f5d-43fb-be04-c8ecbbbcea08 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.739572] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.739672] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.740066] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.740066] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('260ad733-0f5d-43fb-be04-c8ecbbbcea08',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.741420] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-260ad733-0f5d-43fb-be04-c8ecbbbcea08 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.741597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.741697] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.741956] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.742202] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.742359] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.742450] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.742678] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.742813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.742964] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('260ad733-0f5d-43fb-be04-c8ecbbbcea08',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.744900] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-d5bc6f93-685b-4d9c-bb32-6b25e1b25d30 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.744900] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d5bc6f93-685b-4d9c-bb32-6b25e1b25d30" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.745120] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d5bc6f93-685b-4d9c-bb32-6b25e1b25d30" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.745221] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d5bc6f93-685b-4d9c-bb32-6b25e1b25d30" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.745313] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d5bc6f93-685b-4d9c-bb32-6b25e1b25d30',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.247888] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-260ad733-0f5d-43fb-be04-c8ecbbbcea08 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.248620] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.248620] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('260ad733-0f5d-43fb-be04-c8ecbbbcea08',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.252269] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d5bc6f93-685b-4d9c-bb32-6b25e1b25d30 with status ACTIVE [ 642.252269] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.252269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.252269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.252269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.252269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.252269] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.252269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.252269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.252269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.252269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.252269] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.252269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.252269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.252269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.252269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.252269] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d5bc6f93-685b-4d9c-bb32-6b25e1b25d30 is going to be updated. [ 642.288705] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.288938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.289051] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.289361] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.289569] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.289816] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d5bc6f93-685b-4d9c-bb32-6b25e1b25d30" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.523896] env[65322]: INFO networking_nsxv3.common.synchronization [None req-52f6c973-e0cd-4ea9-80e6-3ef2069d64a6 None None] Enqueued Resource ID: 89efc95a-c278-49f1-9639-c07150671ad8 with Priority: HIGHEST for action port [ 642.525274] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89efc95a-c278-49f1-9639-c07150671ad8 with Priority: HIGHEST for action port [ 642.525274] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-89efc95a-c278-49f1-9639-c07150671ad8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.525410] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89efc95a-c278-49f1-9639-c07150671ad8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.525449] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89efc95a-c278-49f1-9639-c07150671ad8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.525719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89efc95a-c278-49f1-9639-c07150671ad8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.526591] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89efc95a-c278-49f1-9639-c07150671ad8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.634474] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02830029-f973-4892-9d06-f25f8aee730a in Status: SUCCESS [ 642.634727] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.753644] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('260ad733-0f5d-43fb-be04-c8ecbbbcea08',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.809247] env[65322]: INFO networking_nsxv3.common.synchronization [req-1c0e00fa-92a2-4195-8021-ce0dd2a27578 req-2654e045-85ba-40de-ba83-7f3670048cca tempest-ServerMetadataNegativeTestJSON-965581318 tempest-ServerMetadataNegativeTestJSON-965581318-project-member] Enqueued Resource ID: 694536fa-8e1e-4cf0-9017-118a0337a180 with Priority: HIGHEST for action security_group_members [ 642.809247] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 694536fa-8e1e-4cf0-9017-118a0337a180 with Priority: HIGHEST for action security_group_members [ 642.811099] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-694536fa-8e1e-4cf0-9017-118a0337a180 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.811099] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.811099] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.811099] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.811402] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.811402] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.811402] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.811552] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.811644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.811740] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('694536fa-8e1e-4cf0-9017-118a0337a180',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.972587] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 in Status: SUCCESS [ 642.972587] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.972958] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.973259] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.973506] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.975894] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.975894] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.975894] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.975894] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.975894] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.975894] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e834e6a-77bf-4cd6-92bf-e7ad79ee2707',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.030926] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 89efc95a-c278-49f1-9639-c07150671ad8 [ 643.032036] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.032550] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.032550] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.032793] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.033041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.033809] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:89efc95a-c278-49f1-9639-c07150671ad8 already deleted. [ 643.034011] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89efc95a-c278-49f1-9639-c07150671ad8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.259811] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.260571] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.260692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.260969] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.261213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.261892] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 is going to be created. [ 643.290303] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.290303] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.290579] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.290702] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.290851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.302085] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 in Status: UNINITIALIZED for 2s [ 643.315709] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.315862] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.315939] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.316191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.316309] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.316457] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.316551] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.316626] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.316767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.316819] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.316898] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 694536fa-8e1e-4cf0-9017-118a0337a180 already deleted. [ 643.316976] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.320321] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-298 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.320591] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-298" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.320591] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-298" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.320892] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-298" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.321276] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.321488] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.321651] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.322326] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.322444] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.322646] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.322752] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 643.322854] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 643.322952] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 643.323067] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 643.323168] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 643.323621] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 643.344132] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 643.347020] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 643.347020] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 643.347020] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-298" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.347020] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-57bd4e42-6bc5-4701-8c59-4b356c84d0ee taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.347020] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-57bd4e42-6bc5-4701-8c59-4b356c84d0ee" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.347020] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-57bd4e42-6bc5-4701-8c59-4b356c84d0ee" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.347020] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-57bd4e42-6bc5-4701-8c59-4b356c84d0ee" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.347020] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57bd4e42-6bc5-4701-8c59-4b356c84d0ee',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.477557] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.480781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.480781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.480781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.480781] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.480781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.480781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.480781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.480781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.480781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.480781] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.480781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.480781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.480781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.480781] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.480781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.480781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.480781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.480781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.481530] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.481530] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e834e6a-77bf-4cd6-92bf-e7ad79ee2707',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.850129] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.850534] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.850534] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.850860] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.850860] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.851992] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 57bd4e42-6bc5-4701-8c59-4b356c84d0ee not found, creating... [ 643.851992] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.851992] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.851992] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.851992] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.852232] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.852370] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.852492] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.852645] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.853451] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.853451] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.853451] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 57bd4e42-6bc5-4701-8c59-4b356c84d0ee is going to be created. [ 643.879827] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.880494] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.880494] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.880494] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.881344] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.881344] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-57bd4e42-6bc5-4701-8c59-4b356c84d0ee" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.984093] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e834e6a-77bf-4cd6-92bf-e7ad79ee2707: rpc.has_security_group_logging(os_id): False [ 644.004877] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.005054] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.005106] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.005435] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.005754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.005831] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.005943] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.006014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.006291] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.006479] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.006590] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.006689] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.006751] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.006998] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.006998] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.007217] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.007343] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.007395] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.007541] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.007618] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.007700] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 is going to be created. [ 644.108614] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.108614] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.108614] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.108614] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.108614] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.130540] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 in Status: IN_PROGRESS for 2s [ 644.560089] env[65322]: INFO networking_nsxv3.common.synchronization [None req-db8cde03-2bb7-4372-89ff-736602d753cc None None] Enqueued Resource ID: 1fc58d74-e0d3-483d-86ef-9ba95373a083 with Priority: HIGHEST for action port [ 644.560683] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fc58d74-e0d3-483d-86ef-9ba95373a083 with Priority: HIGHEST for action port [ 644.561008] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fc58d74-e0d3-483d-86ef-9ba95373a083 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.561202] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fc58d74-e0d3-483d-86ef-9ba95373a083" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.561266] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fc58d74-e0d3-483d-86ef-9ba95373a083" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.561660] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fc58d74-e0d3-483d-86ef-9ba95373a083" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.561770] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fc58d74-e0d3-483d-86ef-9ba95373a083',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.656641] env[65322]: INFO networking_nsxv3.common.synchronization [req-1c0e00fa-92a2-4195-8021-ce0dd2a27578 req-70e0b556-e010-430d-9548-a14430d7d6c6 service nova] Enqueued Resource ID: 694536fa-8e1e-4cf0-9017-118a0337a180 with Priority: HIGHEST for action security_group_rules [ 644.656641] env[65322]: INFO networking_nsxv3.common.synchronization [req-1c0e00fa-92a2-4195-8021-ce0dd2a27578 req-70e0b556-e010-430d-9548-a14430d7d6c6 service nova] Enqueued Resource ID: 694536fa-8e1e-4cf0-9017-118a0337a180 with Priority: HIGHEST for action security_group_members [ 644.657045] env[65322]: INFO networking_nsxv3.common.synchronization [req-1c0e00fa-92a2-4195-8021-ce0dd2a27578 req-70e0b556-e010-430d-9548-a14430d7d6c6 service nova] Enqueued Resource ID: 57bd4e42-6bc5-4701-8c59-4b356c84d0ee with Priority: HIGHEST for action port [ 644.661555] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 694536fa-8e1e-4cf0-9017-118a0337a180 with Priority: HIGHEST for action security_group_rules [ 644.661555] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 694536fa-8e1e-4cf0-9017-118a0337a180 with Priority: HIGHEST for action security_group_members [ 644.661555] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57bd4e42-6bc5-4701-8c59-4b356c84d0ee with Priority: HIGHEST for action port [ 644.661555] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-694536fa-8e1e-4cf0-9017-118a0337a180 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.661555] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.661555] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.661555] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.661555] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('694536fa-8e1e-4cf0-9017-118a0337a180',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.661555] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-694536fa-8e1e-4cf0-9017-118a0337a180 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.661555] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.661555] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.661555] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.661555] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.661555] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.661555] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.661555] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.661555] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.661555] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('694536fa-8e1e-4cf0-9017-118a0337a180',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.666928] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-57bd4e42-6bc5-4701-8c59-4b356c84d0ee taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.667091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57bd4e42-6bc5-4701-8c59-4b356c84d0ee" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.667323] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57bd4e42-6bc5-4701-8c59-4b356c84d0ee" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.667652] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57bd4e42-6bc5-4701-8c59-4b356c84d0ee" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.667739] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57bd4e42-6bc5-4701-8c59-4b356c84d0ee',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.065845] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1fc58d74-e0d3-483d-86ef-9ba95373a083 [ 645.066230] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.066230] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.066352] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.066951] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.066951] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.066951] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1fc58d74-e0d3-483d-86ef-9ba95373a083 already deleted. [ 645.066951] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fc58d74-e0d3-483d-86ef-9ba95373a083" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.168735] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('694536fa-8e1e-4cf0-9017-118a0337a180',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.171274] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-694536fa-8e1e-4cf0-9017-118a0337a180 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.171274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.171274] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57bd4e42-6bc5-4701-8c59-4b356c84d0ee with status ACTIVE [ 645.171274] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.171274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.171274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.171274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.171274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.171274] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.171274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.171274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.171821] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.171821] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.171821] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.172031] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.172031] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.172116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.172600] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.172600] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57bd4e42-6bc5-4701-8c59-4b356c84d0ee is going to be updated. [ 645.201204] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.201422] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.201505] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.201792] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.201952] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.202184] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57bd4e42-6bc5-4701-8c59-4b356c84d0ee" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.314937] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 in Status: SUCCESS [ 645.315187] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.315368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.315594] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.315788] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.315922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.315991] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.316993] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.316993] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.316993] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.316993] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('260ad733-0f5d-43fb-be04-c8ecbbbcea08',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.671467] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('694536fa-8e1e-4cf0-9017-118a0337a180',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.820345] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('260ad733-0f5d-43fb-be04-c8ecbbbcea08',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.150981] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 in Status: SUCCESS [ 646.151411] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.174207] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.174490] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.174558] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.174865] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.174981] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.175102] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 694536fa-8e1e-4cf0-9017-118a0337a180 is going to be created. [ 646.200828] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.200968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.201079] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.201387] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.201546] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.212426] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 694536fa-8e1e-4cf0-9017-118a0337a180 in Status: UNINITIALIZED for 2s [ 646.323214] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 260ad733-0f5d-43fb-be04-c8ecbbbcea08: rpc.has_security_group_logging(os_id): False [ 646.341546] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.341546] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.341821] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.341869] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.341956] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.342241] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.342353] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.342531] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.342601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.342636] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.342725] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 is going to be created. [ 646.410947] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.410947] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.410947] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.410947] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.410947] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.423454] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 in Status: IN_PROGRESS for 2s [ 647.721943] env[65322]: INFO networking_nsxv3.common.synchronization [req-a8b99063-aa00-411a-a9ad-19ec9a209db4 req-8c113b19-a714-432d-a9eb-f5bd03373069 tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 647.722271] env[65322]: INFO networking_nsxv3.common.synchronization [req-a8b99063-aa00-411a-a9ad-19ec9a209db4 req-8c113b19-a714-432d-a9eb-f5bd03373069 tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb with Priority: HIGHEST for action security_group_members [ 647.722651] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 647.722746] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb with Priority: HIGHEST for action security_group_members [ 647.723024] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.723149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.723209] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.723401] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.723547] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.723634] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.723701] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.724136] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.724136] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.724136] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.725191] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-08f780ea-bce2-462d-b3b7-63ec1260a6bb taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.725191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.725314] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.725482] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.725682] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.725785] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.725785] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.725991] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.725991] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.726114] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08f780ea-bce2-462d-b3b7-63ec1260a6bb',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.767506] env[65322]: INFO networking_nsxv3.common.synchronization [req-a8b99063-aa00-411a-a9ad-19ec9a209db4 req-8c113b19-a714-432d-a9eb-f5bd03373069 tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb with Priority: HIGHEST for action security_group_rules [ 647.767682] env[65322]: INFO networking_nsxv3.common.synchronization [req-a8b99063-aa00-411a-a9ad-19ec9a209db4 req-8c113b19-a714-432d-a9eb-f5bd03373069 tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb with Priority: HIGHEST for action security_group_members [ 647.767844] env[65322]: INFO networking_nsxv3.common.synchronization [req-a8b99063-aa00-411a-a9ad-19ec9a209db4 req-8c113b19-a714-432d-a9eb-f5bd03373069 tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_rules [ 647.768218] env[65322]: INFO networking_nsxv3.common.synchronization [req-a8b99063-aa00-411a-a9ad-19ec9a209db4 req-8c113b19-a714-432d-a9eb-f5bd03373069 tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 647.768218] env[65322]: INFO networking_nsxv3.common.synchronization [req-a8b99063-aa00-411a-a9ad-19ec9a209db4 req-8c113b19-a714-432d-a9eb-f5bd03373069 tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: cb362e0c-042e-427b-afc6-6937ce9d7904 with Priority: HIGHEST for action port [ 647.768723] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb with Priority: HIGHEST for action security_group_rules [ 647.768861] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_rules [ 647.768957] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb362e0c-042e-427b-afc6-6937ce9d7904 with Priority: HIGHEST for action port [ 647.769146] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb with Priority: HIGHEST for action security_group_members [ 647.769316] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 647.769609] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08f780ea-bce2-462d-b3b7-63ec1260a6bb taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.769737] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.769789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.770645] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.770726] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08f780ea-bce2-462d-b3b7-63ec1260a6bb',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.771769] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.771916] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.771984] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.772314] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.772426] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.773602] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb362e0c-042e-427b-afc6-6937ce9d7904 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.773740] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb362e0c-042e-427b-afc6-6937ce9d7904" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.773811] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb362e0c-042e-427b-afc6-6937ce9d7904" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.774040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb362e0c-042e-427b-afc6-6937ce9d7904" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.774100] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb362e0c-042e-427b-afc6-6937ce9d7904',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.774922] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-08f780ea-bce2-462d-b3b7-63ec1260a6bb taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.774989] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.775203] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.775449] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.227376] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 694536fa-8e1e-4cf0-9017-118a0337a180 in Status: UNINITIALIZED for 4s [ 648.227719] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.230495] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08f780ea-bce2-462d-b3b7-63ec1260a6bb',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.276454] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-08f780ea-bce2-462d-b3b7-63ec1260a6bb taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.276645] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.276846] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.276973] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.277566] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb362e0c-042e-427b-afc6-6937ce9d7904 with status ACTIVE [ 648.277786] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.278211] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.278211] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.278211] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.278419] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.278502] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.278648] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.278744] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.279289] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.279289] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.279403] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.279493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.279577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.279745] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.279832] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.279929] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb362e0c-042e-427b-afc6-6937ce9d7904 is going to be updated. [ 648.307530] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.307530] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.307530] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.307979] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.307979] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.308102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb362e0c-042e-427b-afc6-6937ce9d7904" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.455807] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 in Status: SUCCESS [ 648.455807] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.732339] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.735472] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08f780ea-bce2-462d-b3b7-63ec1260a6bb',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.861528] env[65322]: INFO networking_nsxv3.common.synchronization [req-2e098cbd-167e-428d-9344-f9f4b90518aa req-1d24dcb2-9b0b-493f-a449-449773c1be0d tempest-VolumesAdminNegativeTest-903707110 tempest-VolumesAdminNegativeTest-903707110-project-member] Enqueued Resource ID: 51992ebb-4768-42b5-9c53-db9beef2ee89 with Priority: HIGHEST for action security_group_members [ 648.861528] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51992ebb-4768-42b5-9c53-db9beef2ee89 with Priority: HIGHEST for action security_group_members [ 648.861806] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-51992ebb-4768-42b5-9c53-db9beef2ee89 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.861806] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.863093] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.863586] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.863848] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.864024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.864131] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.864398] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.864511] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.864637] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('51992ebb-4768-42b5-9c53-db9beef2ee89',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.235856] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.235856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.236076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.236235] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.236298] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.236343] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e65996f-05e7-4178-bdb9-30270bc56380 is going to be updated. [ 649.237683] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.237791] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.237872] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.238145] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.238191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.239107] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb is going to be created. [ 649.285740] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.285740] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.285740] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.285740] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.285740] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.291568] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.291838] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.291838] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.293255] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.293255] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.300775] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb in Status: UNINITIALIZED for 2s [ 649.304566] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: IN_PROGRESS for 2s [ 649.367552] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.367552] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.367773] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.367903] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.367999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.368246] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.368390] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.368456] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.368618] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.368717] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.368944] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51992ebb-4768-42b5-9c53-db9beef2ee89 is going to be updated. [ 649.409577] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.409765] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.409765] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.410349] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.410556] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.433356] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51992ebb-4768-42b5-9c53-db9beef2ee89 in Status: IN_PROGRESS for 2s [ 649.920556] env[65322]: INFO networking_nsxv3.common.synchronization [req-1c7e0597-c8d5-4ed9-b433-8f4d813c7c00 req-0996669b-07d5-4708-a6d4-fcc9fc70b28d tempest-AttachInterfacesV270Test-1350281496 tempest-AttachInterfacesV270Test-1350281496-project-member] Enqueued Resource ID: f508506d-1a05-435a-98ce-ae1f55ed3c92 with Priority: HIGHEST for action security_group_members [ 649.921265] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f508506d-1a05-435a-98ce-ae1f55ed3c92 with Priority: HIGHEST for action security_group_members [ 649.921772] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f508506d-1a05-435a-98ce-ae1f55ed3c92 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.921772] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.921931] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.922087] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.922279] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.922433] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.922433] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.922545] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.922636] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.922728] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f508506d-1a05-435a-98ce-ae1f55ed3c92',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.245686] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 694536fa-8e1e-4cf0-9017-118a0337a180 in Status: SUCCESS [ 650.245686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.245686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.245686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.245686] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.245686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.245686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.245686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.245686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.245686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.245686] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('694536fa-8e1e-4cf0-9017-118a0337a180',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.425687] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.425875] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.425949] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.426203] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.426311] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.426521] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.426623] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.426685] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.426832] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.426922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.427015] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f508506d-1a05-435a-98ce-ae1f55ed3c92 is going to be updated. [ 650.468549] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.469915] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.469915] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.469915] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.469915] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.483485] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f508506d-1a05-435a-98ce-ae1f55ed3c92 in Status: IN_PROGRESS for 2s [ 650.749597] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-694536fa-8e1e-4cf0-9017-118a0337a180 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.749597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.749597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.749597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.749597] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.749597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.749597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.749597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.749597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.749597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.749597] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-694536fa-8e1e-4cf0-9017-118a0337a180 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.749597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.750560] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.750560] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.750560] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.750560] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.750560] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.750560] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.750560] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.750560] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.750560] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('694536fa-8e1e-4cf0-9017-118a0337a180',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.110729] env[65322]: INFO networking_nsxv3.common.synchronization [None req-e1937d41-661d-4351-8b9a-561454a0dd83 None None] Enqueued Resource ID: ae1a005d-0fae-4bde-9a6c-7fcc24e007e8 with Priority: HIGHEST for action port [ 651.110729] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae1a005d-0fae-4bde-9a6c-7fcc24e007e8 with Priority: HIGHEST for action port [ 651.110729] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae1a005d-0fae-4bde-9a6c-7fcc24e007e8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.110729] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae1a005d-0fae-4bde-9a6c-7fcc24e007e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.110729] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae1a005d-0fae-4bde-9a6c-7fcc24e007e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.110729] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae1a005d-0fae-4bde-9a6c-7fcc24e007e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.110729] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae1a005d-0fae-4bde-9a6c-7fcc24e007e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.256615] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 694536fa-8e1e-4cf0-9017-118a0337a180: rpc.has_security_group_logging(os_id): False [ 651.277668] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.280024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.280024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.280024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.280024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.280024] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.280024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.280024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.280024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.280024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.280024] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.280024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.280024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.280024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.280024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.280633] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.281247] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.281459] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.281738] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.281917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.282100] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 694536fa-8e1e-4cf0-9017-118a0337a180 is going to be created. [ 651.315086] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb in Status: SUCCESS [ 651.315086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.315086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.315086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.315086] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.315086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.315086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.315086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.315086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.315721] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08f780ea-bce2-462d-b3b7-63ec1260a6bb',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.317713] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: SUCCESS [ 651.318160] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.318526] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.318912] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.319523] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.319780] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.320044] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.320431] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.320622] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.320812] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.366406] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.366650] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.366650] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.366862] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.367177] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.378412] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 694536fa-8e1e-4cf0-9017-118a0337a180 in Status: IN_PROGRESS for 2s [ 651.446741] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 51992ebb-4768-42b5-9c53-db9beef2ee89 in Status: SUCCESS [ 651.447422] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 51992ebb-4768-42b5-9c53-db9beef2ee89 deletion is rescheduled due to dependency. [ 651.447637] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-51992ebb-4768-42b5-9c53-db9beef2ee89" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.616897] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae1a005d-0fae-4bde-9a6c-7fcc24e007e8 [ 651.616897] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.618039] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.618039] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.618039] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.618039] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.618039] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae1a005d-0fae-4bde-9a6c-7fcc24e007e8 already deleted. [ 651.618519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae1a005d-0fae-4bde-9a6c-7fcc24e007e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.822701] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08f780ea-bce2-462d-b3b7-63ec1260a6bb',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.824277] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.278477] env[65322]: INFO networking_nsxv3.common.synchronization [req-f4b73921-978c-4723-a197-56f2d26d5cd6 req-e811f0de-d786-4129-9968-0bbf27a31c0b tempest-ServerExternalEventsTest-475623796 tempest-ServerExternalEventsTest-475623796-project-member] Enqueued Resource ID: 8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd with Priority: HIGHEST for action security_group_members [ 652.279219] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd with Priority: HIGHEST for action security_group_members [ 652.280055] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.280055] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.280055] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.280772] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.280957] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.281188] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.281188] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.281743] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.281743] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.282130] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.333497] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08f780ea-bce2-462d-b3b7-63ec1260a6bb',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.334712] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.498026] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f508506d-1a05-435a-98ce-ae1f55ed3c92 in Status: SUCCESS [ 652.498026] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f508506d-1a05-435a-98ce-ae1f55ed3c92 deletion is rescheduled due to dependency. [ 652.498026] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.785675] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.786103] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.786188] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.786459] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.786564] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.786814] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.786927] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.787027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.787219] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.787312] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.787419] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd already deleted. [ 652.787601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.839114] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.839114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.839114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.839114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.839114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.839114] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e65996f-05e7-4178-bdb9-30270bc56380 is going to be updated. [ 652.842098] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.842330] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.842473] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.842856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.843154] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.843703] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb is going to be updated. [ 652.903038] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.903038] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.903038] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.903038] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.903038] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.907083] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.907343] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.907343] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.907905] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.908480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.923632] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: IN_PROGRESS for 2s [ 652.925597] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb in Status: IN_PROGRESS for 2s [ 653.313869] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-620 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.314448] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.314862] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.315334] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.315523] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.315705] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.315828] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.316085] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.316249] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.316456] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 653.316591] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 653.316700] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 653.316801] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 653.316915] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 653.317047] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 653.317189] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 653.341751] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 653.342506] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 653.342996] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 653.343827] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.344281] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-dc955a9b-af99-4c2e-8dd5-0fde9b1c4d83 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.344542] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-dc955a9b-af99-4c2e-8dd5-0fde9b1c4d83" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.345570] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-dc955a9b-af99-4c2e-8dd5-0fde9b1c4d83" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.345989] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-dc955a9b-af99-4c2e-8dd5-0fde9b1c4d83" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.346181] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc955a9b-af99-4c2e-8dd5-0fde9b1c4d83',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.393710] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 694536fa-8e1e-4cf0-9017-118a0337a180 in Status: SUCCESS [ 653.393710] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.414121] env[65322]: INFO networking_nsxv3.common.synchronization [None req-075eda46-8bdd-4e27-8db5-7a119acfe53c None None] Enqueued Resource ID: d178dbad-a1bb-4d4e-bda1-79f7f7049126 with Priority: HIGHEST for action port [ 653.416186] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d178dbad-a1bb-4d4e-bda1-79f7f7049126 with Priority: HIGHEST for action port [ 653.417022] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-d178dbad-a1bb-4d4e-bda1-79f7f7049126 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.417425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d178dbad-a1bb-4d4e-bda1-79f7f7049126" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.418964] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d178dbad-a1bb-4d4e-bda1-79f7f7049126" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.418964] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d178dbad-a1bb-4d4e-bda1-79f7f7049126" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.418964] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d178dbad-a1bb-4d4e-bda1-79f7f7049126',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.851679] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.852183] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.856021] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.856021] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.856021] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.856021] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port dc955a9b-af99-4c2e-8dd5-0fde9b1c4d83 not found, creating... [ 653.856021] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.856021] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.856021] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.856021] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.856021] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.856021] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.856579] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.856579] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.857067] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.857338] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.858255] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: dc955a9b-af99-4c2e-8dd5-0fde9b1c4d83 is going to be created. [ 653.885651] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.885651] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.885651] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.885651] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.885651] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.885651] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-dc955a9b-af99-4c2e-8dd5-0fde9b1c4d83" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.920645] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d178dbad-a1bb-4d4e-bda1-79f7f7049126 [ 653.920980] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.921200] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.921385] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.921688] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.921833] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.921972] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d178dbad-a1bb-4d4e-bda1-79f7f7049126 already deleted. [ 653.922143] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d178dbad-a1bb-4d4e-bda1-79f7f7049126" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.178338] env[65322]: INFO networking_nsxv3.common.synchronization [None req-e926432e-1a1f-44c0-882a-b51789702cee None None] Enqueued Resource ID: 1268b6bf-9e76-4972-ad72-7bfdfdfa54bd with Priority: HIGHEST for action port [ 654.179029] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1268b6bf-9e76-4972-ad72-7bfdfdfa54bd with Priority: HIGHEST for action port [ 654.179407] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-1268b6bf-9e76-4972-ad72-7bfdfdfa54bd taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.179541] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1268b6bf-9e76-4972-ad72-7bfdfdfa54bd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.179608] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1268b6bf-9e76-4972-ad72-7bfdfdfa54bd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.179882] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1268b6bf-9e76-4972-ad72-7bfdfdfa54bd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.179966] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1268b6bf-9e76-4972-ad72-7bfdfdfa54bd',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.452703] env[65322]: INFO networking_nsxv3.common.synchronization [req-189134d7-b6fe-4f9a-bdf7-3e963e5ca260 req-91cbd61d-59fc-4351-b5b3-93578c5f5a2e tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb with Priority: HIGHEST for action security_group_members [ 654.452989] env[65322]: INFO networking_nsxv3.common.synchronization [req-189134d7-b6fe-4f9a-bdf7-3e963e5ca260 req-91cbd61d-59fc-4351-b5b3-93578c5f5a2e tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 654.452989] env[65322]: INFO networking_nsxv3.common.synchronization [req-189134d7-b6fe-4f9a-bdf7-3e963e5ca260 req-91cbd61d-59fc-4351-b5b3-93578c5f5a2e tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 506e677b-3a46-4740-8e93-f6dcf6d18933 with Priority: HIGHEST for action security_group_members [ 654.453505] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb with Priority: HIGHEST for action security_group_members [ 654.453767] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 654.453767] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 506e677b-3a46-4740-8e93-f6dcf6d18933 with Priority: HIGHEST for action security_group_members [ 654.454229] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-08f780ea-bce2-462d-b3b7-63ec1260a6bb taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.454363] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.454593] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.454678] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.454846] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-506e677b-3a46-4740-8e93-f6dcf6d18933 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.454951] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-506e677b-3a46-4740-8e93-f6dcf6d18933" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.455031] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-506e677b-3a46-4740-8e93-f6dcf6d18933" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.455286] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-506e677b-3a46-4740-8e93-f6dcf6d18933" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.455440] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.455532] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.455593] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.455750] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.455840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.455918] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('506e677b-3a46-4740-8e93-f6dcf6d18933',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.513254] env[65322]: INFO networking_nsxv3.common.synchronization [req-189134d7-b6fe-4f9a-bdf7-3e963e5ca260 req-91cbd61d-59fc-4351-b5b3-93578c5f5a2e tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb with Priority: HIGHEST for action security_group_rules [ 654.513254] env[65322]: INFO networking_nsxv3.common.synchronization [req-189134d7-b6fe-4f9a-bdf7-3e963e5ca260 req-91cbd61d-59fc-4351-b5b3-93578c5f5a2e tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb with Priority: HIGHEST for action security_group_members [ 654.513254] env[65322]: INFO networking_nsxv3.common.synchronization [req-189134d7-b6fe-4f9a-bdf7-3e963e5ca260 req-91cbd61d-59fc-4351-b5b3-93578c5f5a2e tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 506e677b-3a46-4740-8e93-f6dcf6d18933 with Priority: HIGHEST for action security_group_rules [ 654.513254] env[65322]: INFO networking_nsxv3.common.synchronization [req-189134d7-b6fe-4f9a-bdf7-3e963e5ca260 req-91cbd61d-59fc-4351-b5b3-93578c5f5a2e tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 506e677b-3a46-4740-8e93-f6dcf6d18933 with Priority: HIGHEST for action security_group_members [ 654.513254] env[65322]: INFO networking_nsxv3.common.synchronization [req-189134d7-b6fe-4f9a-bdf7-3e963e5ca260 req-91cbd61d-59fc-4351-b5b3-93578c5f5a2e tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_rules [ 654.513254] env[65322]: INFO networking_nsxv3.common.synchronization [req-189134d7-b6fe-4f9a-bdf7-3e963e5ca260 req-91cbd61d-59fc-4351-b5b3-93578c5f5a2e tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 654.514235] env[65322]: INFO networking_nsxv3.common.synchronization [req-189134d7-b6fe-4f9a-bdf7-3e963e5ca260 req-91cbd61d-59fc-4351-b5b3-93578c5f5a2e tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: cb362e0c-042e-427b-afc6-6937ce9d7904 with Priority: HIGHEST for action port [ 654.514918] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb with Priority: HIGHEST for action security_group_rules [ 654.515060] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 506e677b-3a46-4740-8e93-f6dcf6d18933 with Priority: HIGHEST for action security_group_rules [ 654.515161] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 654.515251] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb362e0c-042e-427b-afc6-6937ce9d7904 with Priority: HIGHEST for action port [ 654.515358] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_rules [ 654.515519] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb with Priority: HIGHEST for action security_group_members [ 654.515611] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 506e677b-3a46-4740-8e93-f6dcf6d18933 with Priority: HIGHEST for action security_group_members [ 654.515908] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08f780ea-bce2-462d-b3b7-63ec1260a6bb taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.516018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.516225] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-506e677b-3a46-4740-8e93-f6dcf6d18933 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.516293] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-506e677b-3a46-4740-8e93-f6dcf6d18933" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.516354] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-506e677b-3a46-4740-8e93-f6dcf6d18933" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.516670] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-506e677b-3a46-4740-8e93-f6dcf6d18933" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.516742] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('506e677b-3a46-4740-8e93-f6dcf6d18933',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.518168] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.518307] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.518439] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb362e0c-042e-427b-afc6-6937ce9d7904 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.518620] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb362e0c-042e-427b-afc6-6937ce9d7904" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.518768] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb362e0c-042e-427b-afc6-6937ce9d7904" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.518959] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb362e0c-042e-427b-afc6-6937ce9d7904" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.519066] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb362e0c-042e-427b-afc6-6937ce9d7904',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.520684] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.520684] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.520958] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-08f780ea-bce2-462d-b3b7-63ec1260a6bb taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.520958] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.522389] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-506e677b-3a46-4740-8e93-f6dcf6d18933 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.522389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-506e677b-3a46-4740-8e93-f6dcf6d18933" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.640220] env[65322]: INFO networking_nsxv3.common.synchronization [req-f4b73921-978c-4723-a197-56f2d26d5cd6 req-2065558b-94a5-4bc4-aa8b-3763e92592bd service nova] Enqueued Resource ID: 8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd with Priority: HIGHEST for action security_group_rules [ 654.640385] env[65322]: INFO networking_nsxv3.common.synchronization [req-f4b73921-978c-4723-a197-56f2d26d5cd6 req-2065558b-94a5-4bc4-aa8b-3763e92592bd service nova] Enqueued Resource ID: 8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd with Priority: HIGHEST for action security_group_members [ 654.640508] env[65322]: INFO networking_nsxv3.common.synchronization [req-f4b73921-978c-4723-a197-56f2d26d5cd6 req-2065558b-94a5-4bc4-aa8b-3763e92592bd service nova] Enqueued Resource ID: dc955a9b-af99-4c2e-8dd5-0fde9b1c4d83 with Priority: HIGHEST for action port [ 654.641441] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd with Priority: HIGHEST for action security_group_rules [ 654.641620] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd with Priority: HIGHEST for action security_group_members [ 654.641718] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc955a9b-af99-4c2e-8dd5-0fde9b1c4d83 with Priority: HIGHEST for action port [ 654.642041] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.642903] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.642903] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.642903] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.642903] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.643863] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.643863] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.643997] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.644230] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.644401] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.644525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.644619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.644850] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.644945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.646679] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.647339] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc955a9b-af99-4c2e-8dd5-0fde9b1c4d83 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.647451] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc955a9b-af99-4c2e-8dd5-0fde9b1c4d83" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.647514] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc955a9b-af99-4c2e-8dd5-0fde9b1c4d83" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.647676] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc955a9b-af99-4c2e-8dd5-0fde9b1c4d83" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.647749] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc955a9b-af99-4c2e-8dd5-0fde9b1c4d83',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.681695] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1268b6bf-9e76-4972-ad72-7bfdfdfa54bd [ 654.682970] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.682970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.682970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.682970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.683257] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.683614] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1268b6bf-9e76-4972-ad72-7bfdfdfa54bd already deleted. [ 654.683706] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1268b6bf-9e76-4972-ad72-7bfdfdfa54bd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.937384] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb in Status: SUCCESS [ 654.938124] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.938494] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.938857] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.939232] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.939534] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.939746] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.940107] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.940329] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.940477] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.940626] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('08f780ea-bce2-462d-b3b7-63ec1260a6bb',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.942610] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: SUCCESS [ 654.942610] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.942757] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.943057] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.944162] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.944325] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.944413] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.944600] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.944691] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.944784] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08f780ea-bce2-462d-b3b7-63ec1260a6bb',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.945724] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.946340] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.946603] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.946988] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.946988] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.946988] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.947197] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.947197] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.947197] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.949373] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.949766] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.949982] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.950172] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.950259] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.950441] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.950563] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.950681] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.952633] env[65322]: INFO networking_nsxv3.common.synchronization [req-57a1c3ec-e28d-4bf5-9869-bce8faa4f563 req-a3abf6ca-c521-4624-8c9b-c119d4680bab tempest-ServerDiagnosticsNegativeTest-159621058 tempest-ServerDiagnosticsNegativeTest-159621058-project-member] Enqueued Resource ID: cf5d3fd5-a83d-454c-811a-c9b2e590ac47 with Priority: HIGHEST for action security_group_members [ 654.954244] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf5d3fd5-a83d-454c-811a-c9b2e590ac47 with Priority: HIGHEST for action security_group_members [ 654.954244] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.954244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.954244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.954244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.954494] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.954549] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.954859] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.954859] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.955011] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.955198] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf5d3fd5-a83d-454c-811a-c9b2e590ac47',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.955705] env[65322]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 654.959152] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('506e677b-3a46-4740-8e93-f6dcf6d18933',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.019324] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-506e677b-3a46-4740-8e93-f6dcf6d18933 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.019507] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-506e677b-3a46-4740-8e93-f6dcf6d18933" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.022662] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb362e0c-042e-427b-afc6-6937ce9d7904 with status ACTIVE [ 655.022873] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.023067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.023067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.023281] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.023369] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.023544] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.023655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.023715] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.023859] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.023934] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.024114] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.024517] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.024517] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.024517] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.024517] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.024695] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb362e0c-042e-427b-afc6-6937ce9d7904 is going to be updated. [ 655.050151] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.050349] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.050435] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.050739] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.050935] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.051216] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb362e0c-042e-427b-afc6-6937ce9d7904" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.129892] env[65322]: INFO networking_nsxv3.common.synchronization [req-7b24e128-7c8d-461f-b1bc-ce257e663403 req-d252ab52-9709-4ac7-84b7-9e2a2fa37b52 tempest-ListImageFiltersTestJSON-1830232645 tempest-ListImageFiltersTestJSON-1830232645-project-member] Enqueued Resource ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 with Priority: HIGHEST for action security_group_members [ 655.132474] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 with Priority: HIGHEST for action security_group_members [ 655.132474] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.132474] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.132474] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.132474] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.132474] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.132474] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.132474] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.133484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.133484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.133484] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60b11f04-8768-43f5-bcb0-8bb51ec0bdf2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.147757] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.150639] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc955a9b-af99-4c2e-8dd5-0fde9b1c4d83 with status ACTIVE [ 655.150926] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.151017] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.151081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.151368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.151410] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.151592] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.151772] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.152079] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.152142] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.152221] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.152453] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.152575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.152638] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.152813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.152913] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.153039] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc955a9b-af99-4c2e-8dd5-0fde9b1c4d83 is going to be updated. [ 655.154358] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.154485] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.211097] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.211380] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.211477] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.212346] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.212915] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.213132] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc955a9b-af99-4c2e-8dd5-0fde9b1c4d83" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.445417] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-620 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.445679] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.446203] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.446203] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.446330] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.446469] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.446577] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.446809] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.446978] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.447275] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 655.447439] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 655.447569] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 655.447720] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 655.447957] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 655.448162] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 655.448333] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 655.450228] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08f780ea-bce2-462d-b3b7-63ec1260a6bb',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.451284] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('08f780ea-bce2-462d-b3b7-63ec1260a6bb',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.454291] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.454672] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.456749] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.458245] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.458362] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.458424] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.458628] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.458721] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.458921] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.459300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.459300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.459300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.459411] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.459491] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf5d3fd5-a83d-454c-811a-c9b2e590ac47 is going to be updated. [ 655.463530] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('506e677b-3a46-4740-8e93-f6dcf6d18933',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.487787] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 655.487976] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 655.488263] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 655.488386] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.488840] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-ff2b7f72-1e3e-4b2c-936e-b4b26a853c73 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.488963] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-ff2b7f72-1e3e-4b2c-936e-b4b26a853c73" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.489074] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-ff2b7f72-1e3e-4b2c-936e-b4b26a853c73" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.489516] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-ff2b7f72-1e3e-4b2c-936e-b4b26a853c73" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.489648] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff2b7f72-1e3e-4b2c-936e-b4b26a853c73',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.493250] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.493425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.493493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.493749] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.493954] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.509017] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf5d3fd5-a83d-454c-811a-c9b2e590ac47 in Status: IN_PROGRESS for 2s [ 655.636187] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.636577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.636746] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.637060] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.637273] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.637612] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.637869] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.638037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.638362] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.638798] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.638798] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 already deleted. [ 655.638798] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.650737] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.897279] env[65322]: INFO networking_nsxv3.common.synchronization [None req-4ba53a3a-e4d7-4072-9c4c-b3f86495857a None None] Enqueued Resource ID: 6bceac84-95a7-413d-88a4-d236f53d61ff with Priority: HIGHEST for action port [ 655.897334] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bceac84-95a7-413d-88a4-d236f53d61ff with Priority: HIGHEST for action port [ 655.897817] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bceac84-95a7-413d-88a4-d236f53d61ff taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.898152] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bceac84-95a7-413d-88a4-d236f53d61ff" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.898152] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bceac84-95a7-413d-88a4-d236f53d61ff" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.898543] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bceac84-95a7-413d-88a4-d236f53d61ff" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.898666] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bceac84-95a7-413d-88a4-d236f53d61ff',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.953569] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08f780ea-bce2-462d-b3b7-63ec1260a6bb',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.954524] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 08f780ea-bce2-462d-b3b7-63ec1260a6bb: rpc.has_security_group_logging(os_id): False [ 655.962677] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.964604] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.964818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.964818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.965289] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.965411] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.965507] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 506e677b-3a46-4740-8e93-f6dcf6d18933 is going to be created. [ 655.976038] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.977061] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.977061] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.977061] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.977061] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.977061] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.977061] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.977523] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.977523] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.977523] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.977523] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb is going to be created. [ 655.993091] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.993473] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.993473] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.993647] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.993721] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.993945] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port ff2b7f72-1e3e-4b2c-936e-b4b26a853c73 not found, creating... [ 655.994251] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.994404] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.994534] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.994779] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.994927] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.995219] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.995367] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.995498] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.995728] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.995886] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.996116] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: ff2b7f72-1e3e-4b2c-936e-b4b26a853c73 is going to be created. [ 655.998392] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.998572] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.998572] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.998794] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.998974] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.016542] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 506e677b-3a46-4740-8e93-f6dcf6d18933 in Status: UNINITIALIZED for 2s [ 656.026207] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.026207] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.026478] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.027159] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.027781] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.028595] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-ff2b7f72-1e3e-4b2c-936e-b4b26a853c73" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.045962] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.046241] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.046241] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.046523] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.046631] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.061839] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb in Status: IN_PROGRESS for 2s [ 656.157179] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.157179] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.157179] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.157179] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.157179] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.157179] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd is going to be created. [ 656.193900] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.193900] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.193900] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.195267] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.195267] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.209312] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd in Status: UNINITIALIZED for 2s [ 656.406721] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6bceac84-95a7-413d-88a4-d236f53d61ff [ 656.406721] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.406965] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.406965] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.407375] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.407561] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.407710] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6bceac84-95a7-413d-88a4-d236f53d61ff already deleted. [ 656.407864] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bceac84-95a7-413d-88a4-d236f53d61ff" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.456629] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.456956] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.456956] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.458113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.458113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.458113] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb is going to be updated. [ 656.467073] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.467438] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.467604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.467859] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.467981] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.468178] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e65996f-05e7-4178-bdb9-30270bc56380 is going to be updated. [ 656.490702] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.490828] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.490899] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.491136] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.491352] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.493893] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.493893] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.493893] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.493893] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.493893] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.505390] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: IN_PROGRESS for 2s [ 656.506143] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb in Status: IN_PROGRESS for 2s [ 656.724895] env[65322]: INFO networking_nsxv3.common.synchronization [req-7b24e128-7c8d-461f-b1bc-ce257e663403 req-38bfa07b-c05a-45c6-bae2-8e7ea4fdc2ad service nova] Enqueued Resource ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 with Priority: HIGHEST for action security_group_rules [ 656.724895] env[65322]: INFO networking_nsxv3.common.synchronization [req-7b24e128-7c8d-461f-b1bc-ce257e663403 req-38bfa07b-c05a-45c6-bae2-8e7ea4fdc2ad service nova] Enqueued Resource ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 with Priority: HIGHEST for action security_group_members [ 656.725183] env[65322]: INFO networking_nsxv3.common.synchronization [req-7b24e128-7c8d-461f-b1bc-ce257e663403 req-38bfa07b-c05a-45c6-bae2-8e7ea4fdc2ad service nova] Enqueued Resource ID: ff2b7f72-1e3e-4b2c-936e-b4b26a853c73 with Priority: HIGHEST for action port [ 656.725769] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 with Priority: HIGHEST for action security_group_rules [ 656.725949] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 with Priority: HIGHEST for action security_group_members [ 656.726060] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff2b7f72-1e3e-4b2c-936e-b4b26a853c73 with Priority: HIGHEST for action port [ 656.726333] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.726456] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.726523] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.726795] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.726874] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60b11f04-8768-43f5-bcb0-8bb51ec0bdf2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.728007] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.728151] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.728244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.728497] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.728612] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.728716] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.728773] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.728921] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.729015] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.729199] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60b11f04-8768-43f5-bcb0-8bb51ec0bdf2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.729988] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff2b7f72-1e3e-4b2c-936e-b4b26a853c73 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.730072] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff2b7f72-1e3e-4b2c-936e-b4b26a853c73" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.730130] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff2b7f72-1e3e-4b2c-936e-b4b26a853c73" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.730737] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff2b7f72-1e3e-4b2c-936e-b4b26a853c73" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.730737] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff2b7f72-1e3e-4b2c-936e-b4b26a853c73',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.018239] env[65322]: INFO networking_nsxv3.common.synchronization [req-0375c098-c87a-4982-a36b-1e208dab94d0 req-cf707698-e6a9-4b72-b428-e6adcb8d19b5 tempest-ServerDiskConfigTestJSON-1167155511 tempest-ServerDiskConfigTestJSON-1167155511-project-member] Enqueued Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 657.018239] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 657.018239] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.018239] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.018239] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.018710] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.019014] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.019278] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.019477] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.019801] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.020046] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.020242] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.231753] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.232019] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.232330] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60b11f04-8768-43f5-bcb0-8bb51ec0bdf2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.233814] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff2b7f72-1e3e-4b2c-936e-b4b26a853c73 with status ACTIVE [ 657.234093] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.236364] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.236364] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.236619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.236797] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.238241] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.238740] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.238740] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.238740] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.238885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.239036] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.239210] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.240349] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.240349] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.240349] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.240349] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff2b7f72-1e3e-4b2c-936e-b4b26a853c73 is going to be updated. [ 657.264824] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.264824] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.264824] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.264824] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.264824] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.265204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff2b7f72-1e3e-4b2c-936e-b4b26a853c73" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.448997] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-173 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.449218] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-173" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.449336] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-173" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.449657] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-173" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.449918] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.450080] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.450245] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.450492] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.450627] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.450935] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.450935] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 657.451495] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 657.451495] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 657.451495] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.451495] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 657.451817] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 657.498317] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 657.498317] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.047 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 657.498598] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 657.498598] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-173" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.498963] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-0e2adc70-8f28-45b4-b539-15f53a688a7f taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.499421] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-0e2adc70-8f28-45b4-b539-15f53a688a7f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.499578] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-0e2adc70-8f28-45b4-b539-15f53a688a7f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.499916] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-0e2adc70-8f28-45b4-b539-15f53a688a7f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.500107] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e2adc70-8f28-45b4-b539-15f53a688a7f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.519091] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf5d3fd5-a83d-454c-811a-c9b2e590ac47 in Status: SUCCESS [ 657.519332] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf5d3fd5-a83d-454c-811a-c9b2e590ac47 deletion is rescheduled due to dependency. [ 657.519457] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.522581] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.522704] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.522744] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.523017] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.523112] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.523468] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.523468] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.523468] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.523655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.523790] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.523790] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 already deleted. [ 657.523880] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.742429] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60b11f04-8768-43f5-bcb0-8bb51ec0bdf2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.004167] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.004415] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.004608] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.005013] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.005262] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.005389] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 0e2adc70-8f28-45b4-b539-15f53a688a7f not found, creating... [ 658.005675] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.005869] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.006028] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.006260] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.006454] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.006776] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.007042] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.007123] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.007456] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.007614] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.007773] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 0e2adc70-8f28-45b4-b539-15f53a688a7f is going to be created. [ 658.026498] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 506e677b-3a46-4740-8e93-f6dcf6d18933 in Status: SUCCESS [ 658.026718] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-506e677b-3a46-4740-8e93-f6dcf6d18933" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.026891] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-506e677b-3a46-4740-8e93-f6dcf6d18933" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.027154] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-506e677b-3a46-4740-8e93-f6dcf6d18933" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.027320] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.027438] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.027503] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.027701] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.027750] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.027807] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('506e677b-3a46-4740-8e93-f6dcf6d18933',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.034200] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.034466] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.034621] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.035083] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.035468] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.035468] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-0e2adc70-8f28-45b4-b539-15f53a688a7f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.076328] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb in Status: SUCCESS [ 658.076591] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.076792] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.077050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.077149] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08f780ea-bce2-462d-b3b7-63ec1260a6bb',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.222334] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd in Status: UNINITIALIZED for 4s [ 658.245078] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.245281] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.245348] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.245575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.245703] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.245844] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 is going to be created. [ 658.273417] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.273652] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.273652] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.273909] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.274088] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.298843] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 in Status: UNINITIALIZED for 2s [ 658.517162] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: SUCCESS [ 658.517486] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.517682] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.517810] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.518011] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.518825] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.518825] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.518825] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.518825] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.518825] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.520275] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb in Status: SUCCESS [ 658.520469] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.520623] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.520888] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.520952] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.521079] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.521141] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.521336] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.521447] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.521515] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08f780ea-bce2-462d-b3b7-63ec1260a6bb',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.530493] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('506e677b-3a46-4740-8e93-f6dcf6d18933',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.579976] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-08f780ea-bce2-462d-b3b7-63ec1260a6bb taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.580132] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.779656] env[65322]: INFO networking_nsxv3.common.synchronization [req-0375c098-c87a-4982-a36b-1e208dab94d0 req-d739a818-d7f7-4f5c-83eb-7681388a1dde service nova] Enqueued Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_rules [ 658.779824] env[65322]: INFO networking_nsxv3.common.synchronization [req-0375c098-c87a-4982-a36b-1e208dab94d0 req-d739a818-d7f7-4f5c-83eb-7681388a1dde service nova] Enqueued Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 658.779986] env[65322]: INFO networking_nsxv3.common.synchronization [req-0375c098-c87a-4982-a36b-1e208dab94d0 req-d739a818-d7f7-4f5c-83eb-7681388a1dde service nova] Enqueued Resource ID: 0e2adc70-8f28-45b4-b539-15f53a688a7f with Priority: HIGHEST for action port [ 658.780592] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_rules [ 658.780831] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 658.780901] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e2adc70-8f28-45b4-b539-15f53a688a7f with Priority: HIGHEST for action port [ 658.781269] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.781439] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.781510] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.781838] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.781914] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.783528] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.783671] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.783752] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.783930] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.784100] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.784195] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.784256] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.784444] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.784480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.784568] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.787531] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e2adc70-8f28-45b4-b539-15f53a688a7f taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.787597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e2adc70-8f28-45b4-b539-15f53a688a7f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.787690] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e2adc70-8f28-45b4-b539-15f53a688a7f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.788769] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e2adc70-8f28-45b4-b539-15f53a688a7f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.788769] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e2adc70-8f28-45b4-b539-15f53a688a7f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.023527] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.025783] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08f780ea-bce2-462d-b3b7-63ec1260a6bb',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.034295] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('506e677b-3a46-4740-8e93-f6dcf6d18933',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.289395] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.292131] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.292131] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.292131] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e2adc70-8f28-45b4-b539-15f53a688a7f with status ACTIVE [ 659.293795] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.293795] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.293950] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.294200] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.294312] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.294516] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.294622] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.294684] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.295101] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.295101] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.295248] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.295248] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.295418] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.295548] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.295548] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.295927] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e2adc70-8f28-45b4-b539-15f53a688a7f is going to be updated. [ 659.337722] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.339123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.339123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.339123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.339123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.339123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e2adc70-8f28-45b4-b539-15f53a688a7f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.527812] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.527812] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08f780ea-bce2-462d-b3b7-63ec1260a6bb',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.538135] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.538362] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.538472] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.538819] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.538981] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.539094] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 506e677b-3a46-4740-8e93-f6dcf6d18933 is going to be updated. [ 659.573294] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.573666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.573783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.574173] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.576352] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.595037] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 506e677b-3a46-4740-8e93-f6dcf6d18933 in Status: IN_PROGRESS for 2s [ 659.794246] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.030390] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.030575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.030639] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.031601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.031601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.031601] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e65996f-05e7-4178-bdb9-30270bc56380 is going to be updated. [ 660.032658] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.032840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.032988] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.033065] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.033157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.033248] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb is going to be updated. [ 660.067449] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.067664] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.067717] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.067908] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.068073] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.070659] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.070890] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.070890] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.071219] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.071437] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.091167] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb in Status: IN_PROGRESS for 2s [ 660.091971] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: IN_PROGRESS for 2s [ 660.239799] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd in Status: SUCCESS [ 660.240992] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.240992] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.241415] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.241635] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.241840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.241840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.242073] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.242161] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.242249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.242461] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.297318] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.298665] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.298977] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.299318] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.299921] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.300225] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 is going to be created. [ 660.316772] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 in Status: SUCCESS [ 660.316772] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.316772] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.317055] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.317105] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.317287] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.317361] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.317524] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.317602] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.317687] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.317772] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60b11f04-8768-43f5-bcb0-8bb51ec0bdf2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.339505] env[65322]: INFO networking_nsxv3.common.synchronization [req-13012b37-208a-463b-8c8b-8ca0440c289b req-e40c698b-4b23-4355-9624-67b21befcdeb tempest-ServerRescueTestJSON-780090650 tempest-ServerRescueTestJSON-780090650-project-member] Enqueued Resource ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e with Priority: HIGHEST for action security_group_members [ 660.340470] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e with Priority: HIGHEST for action security_group_members [ 660.341759] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.341852] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.341852] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.342156] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.342354] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.342529] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.342593] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.342775] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.342862] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.342960] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88219fc7-d04d-4a0f-88d0-399f8bd7ef8e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.348553] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.348747] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.348819] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.349070] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.349259] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.364881] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: UNINITIALIZED for 2s [ 660.745920] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.750519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.750519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.750519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.750519] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.750519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.750519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.750519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.750519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.750519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.750519] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.750519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.750519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.750519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.750519] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.750519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.750519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.750519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.750519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.751738] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.751738] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.772024] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-241 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.772241] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-241" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.772346] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-241" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.772691] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-241" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.772973] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.773229] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.773372] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.773590] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.773742] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.773937] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.774054] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 660.774159] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 660.774269] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 660.774405] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.774518] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 660.774621] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 660.793499] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 660.793822] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 660.794010] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 660.794109] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-241" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.794453] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-e3d7ff3a-aed0-4071-a1ec-b4c1ec1e69c1 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.794628] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-e3d7ff3a-aed0-4071-a1ec-b4c1ec1e69c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.794803] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-e3d7ff3a-aed0-4071-a1ec-b4c1ec1e69c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.795153] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-e3d7ff3a-aed0-4071-a1ec-b4c1ec1e69c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.795296] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3d7ff3a-aed0-4071-a1ec-b4c1ec1e69c1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.819897] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.820179] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.820291] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.820546] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.820822] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.820822] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.821047] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.821047] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.821143] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.821229] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.821432] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.821541] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.821593] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.821733] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.821866] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.821953] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.822023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.822165] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.822256] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.822382] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.822526] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60b11f04-8768-43f5-bcb0-8bb51ec0bdf2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.854323] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88219fc7-d04d-4a0f-88d0-399f8bd7ef8e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.258037] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd: rpc.has_security_group_logging(os_id): False [ 661.281033] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.281214] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.281297] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.281719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.281842] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.282112] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.282233] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.282293] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.282524] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.282631] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.282901] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.283461] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.283578] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.284688] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.284774] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.285239] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.285239] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.285239] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.285417] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.285417] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.285496] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd is going to be created. [ 661.298860] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.299798] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.299798] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.299983] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.300473] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.300473] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port e3d7ff3a-aed0-4071-a1ec-b4c1ec1e69c1 not found, creating... [ 661.300692] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.300887] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.301011] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.301437] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.301565] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.302254] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.302254] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.302254] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.302562] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.302619] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.302928] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: e3d7ff3a-aed0-4071-a1ec-b4c1ec1e69c1 is going to be created. [ 661.326157] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.326157] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.326157] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.326157] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.327116] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.327116] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-e3d7ff3a-aed0-4071-a1ec-b4c1ec1e69c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.327811] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2: rpc.has_security_group_logging(os_id): False [ 661.358032] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88219fc7-d04d-4a0f-88d0-399f8bd7ef8e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.359995] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.359995] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.360181] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.360294] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.360379] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.360559] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.362091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.362091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.362091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.362091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.362091] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.362091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.362091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.362091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.363529] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.363859] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.364105] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.364281] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.364569] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.364752] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.364995] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 is going to be created. [ 661.410780] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.410966] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.411042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.412833] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.412833] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.439268] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd in Status: IN_PROGRESS for 2s [ 661.454960] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.455186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.455186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.455477] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.455690] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.479121] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 in Status: IN_PROGRESS for 2s [ 661.610145] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 506e677b-3a46-4740-8e93-f6dcf6d18933 in Status: SUCCESS [ 661.610661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-506e677b-3a46-4740-8e93-f6dcf6d18933" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.610661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-506e677b-3a46-4740-8e93-f6dcf6d18933" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.610838] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-506e677b-3a46-4740-8e93-f6dcf6d18933" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.611084] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.611219] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.611290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.611612] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.611765] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.611911] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-506e677b-3a46-4740-8e93-f6dcf6d18933" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.612093] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('506e677b-3a46-4740-8e93-f6dcf6d18933',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.870590] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.871024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.871024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.871162] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.872425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.872638] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e is going to be updated. [ 661.914698] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.914932] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.914932] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.915151] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.915297] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.929862] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e in Status: IN_PROGRESS for 2s [ 662.105480] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: SUCCESS [ 662.106059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.106414] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.106962] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.107321] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.107593] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.107770] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.108103] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.108374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.108687] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.109015] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.111756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.111756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.111756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.111756] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.111756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.111756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.111756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.111756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.111756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.111756] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.114169] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb in Status: SUCCESS [ 662.114614] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.114739] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('506e677b-3a46-4740-8e93-f6dcf6d18933',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.116584] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.116584] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.116584] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.117325] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.117325] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.117325] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.117325] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.117325] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.117325] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('08f780ea-bce2-462d-b3b7-63ec1260a6bb',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.177030] env[65322]: INFO networking_nsxv3.common.synchronization [req-13012b37-208a-463b-8c8b-8ca0440c289b req-1380c94e-4ea8-441a-b58f-02895df5b5b1 service nova] Enqueued Resource ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e with Priority: HIGHEST for action security_group_rules [ 662.177207] env[65322]: INFO networking_nsxv3.common.synchronization [req-13012b37-208a-463b-8c8b-8ca0440c289b req-1380c94e-4ea8-441a-b58f-02895df5b5b1 service nova] Enqueued Resource ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e with Priority: HIGHEST for action security_group_members [ 662.177333] env[65322]: INFO networking_nsxv3.common.synchronization [req-13012b37-208a-463b-8c8b-8ca0440c289b req-1380c94e-4ea8-441a-b58f-02895df5b5b1 service nova] Enqueued Resource ID: e3d7ff3a-aed0-4071-a1ec-b4c1ec1e69c1 with Priority: HIGHEST for action port [ 662.177828] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e with Priority: HIGHEST for action security_group_rules [ 662.177964] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e with Priority: HIGHEST for action security_group_members [ 662.178073] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3d7ff3a-aed0-4071-a1ec-b4c1ec1e69c1 with Priority: HIGHEST for action port [ 662.178342] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.178467] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.178530] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.178778] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.178816] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88219fc7-d04d-4a0f-88d0-399f8bd7ef8e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.180163] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.180163] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.180163] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3d7ff3a-aed0-4071-a1ec-b4c1ec1e69c1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.180163] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3d7ff3a-aed0-4071-a1ec-b4c1ec1e69c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.180163] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3d7ff3a-aed0-4071-a1ec-b4c1ec1e69c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.180404] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3d7ff3a-aed0-4071-a1ec-b4c1ec1e69c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.180404] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3d7ff3a-aed0-4071-a1ec-b4c1ec1e69c1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.378800] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: SUCCESS [ 662.379125] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.379485] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.379777] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.380034] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.380300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.380300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.380481] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.380569] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.380662] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.380762] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.623079] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 506e677b-3a46-4740-8e93-f6dcf6d18933: rpc.has_security_group_logging(os_id): False [ 662.623079] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e65996f-05e7-4178-bdb9-30270bc56380: rpc.has_security_group_logging(os_id): False [ 662.623079] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('08f780ea-bce2-462d-b3b7-63ec1260a6bb',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.648224] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.648458] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.648458] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.648629] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.648680] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.648922] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.649048] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.649048] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.649212] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.649320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.649569] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.649674] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.649748] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.649866] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.649936] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.650173] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.650269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.650333] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.650474] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.650545] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.650651] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e65996f-05e7-4178-bdb9-30270bc56380 is going to be updated. [ 662.653194] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.653354] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.653467] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.653664] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.653779] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.654015] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.654120] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.654182] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.654335] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.654412] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.654497] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 506e677b-3a46-4740-8e93-f6dcf6d18933 is going to be created. [ 662.683179] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.683179] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.683179] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3d7ff3a-aed0-4071-a1ec-b4c1ec1e69c1 with status ACTIVE [ 662.683179] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.683455] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.683455] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.683592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.683771] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.684099] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.684257] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.684347] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.684579] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.684675] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.684924] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.685360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.685479] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.685727] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.685857] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.685993] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3d7ff3a-aed0-4071-a1ec-b4c1ec1e69c1 is going to be updated. [ 662.708285] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.708285] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.708285] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.708285] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.708647] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.708647] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3d7ff3a-aed0-4071-a1ec-b4c1ec1e69c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.721712] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.721861] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.721934] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.722189] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.722367] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.746853] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.746853] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.747101] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.747144] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.747259] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.748865] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 506e677b-3a46-4740-8e93-f6dcf6d18933 in Status: IN_PROGRESS for 2s [ 662.770239] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: IN_PROGRESS for 2s [ 662.883718] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.884223] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.884223] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.884223] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.884386] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.884485] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.884538] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.884729] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.884819] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.884932] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.885098] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.885196] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.885256] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.885400] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.885536] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.885629] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.885688] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.885819] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.885929] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.885971] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.886064] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.130054] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 08f780ea-bce2-462d-b3b7-63ec1260a6bb: rpc.has_security_group_logging(os_id): False [ 663.156067] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.156269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.156404] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.157032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.157032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.157216] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.157216] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.157305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.160102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.160102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.160293] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb is going to be updated. [ 663.246426] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.246611] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.246936] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.247187] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.247862] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.261238] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb in Status: IN_PROGRESS for 2s [ 663.395555] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a34cfbc5-e3ce-4943-8058-702a82703915: rpc.has_security_group_logging(os_id): False [ 663.414423] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.417194] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.417194] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.417194] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.417194] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.417194] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.417194] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.417194] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.417194] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.417194] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.421565] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.421565] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.421565] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.421565] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.421565] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.421565] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.421565] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.421565] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.421565] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.421565] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.421565] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 is going to be created. [ 663.457127] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd in Status: SUCCESS [ 663.457665] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.496696] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 in Status: SUCCESS [ 663.497395] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.515927] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.515927] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.515927] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.515927] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.515927] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.528545] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: IN_PROGRESS for 2s [ 663.943563] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e in Status: SUCCESS [ 663.943961] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.944026] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.946042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.946042] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.946042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.946042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.946042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.946042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.946042] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88219fc7-d04d-4a0f-88d0-399f8bd7ef8e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.448368] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88219fc7-d04d-4a0f-88d0-399f8bd7ef8e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.696809] env[65322]: INFO networking_nsxv3.common.synchronization [req-8c84ecd4-2a3a-4b3f-b60f-3687cfada183 req-cda7baf8-ad29-4527-b726-f3e4ef06e180 tempest-InstanceActionsNegativeTestJSON-2101621013 tempest-InstanceActionsNegativeTestJSON-2101621013-project-member] Enqueued Resource ID: 6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 with Priority: HIGHEST for action security_group_members [ 664.696809] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 with Priority: HIGHEST for action security_group_members [ 664.696980] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.696980] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.697103] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.697255] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.697890] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.697890] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.697890] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.697890] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.697890] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.697890] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e834e6a-77bf-4cd6-92bf-e7ad79ee2707',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.770035] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 506e677b-3a46-4740-8e93-f6dcf6d18933 in Status: SUCCESS [ 664.770035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-506e677b-3a46-4740-8e93-f6dcf6d18933" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.784048] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: SUCCESS [ 664.784048] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.784438] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.784438] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.784512] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.951120] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88219fc7-d04d-4a0f-88d0-399f8bd7ef8e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.201113] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.201622] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.201935] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.202820] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.203909] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.203909] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.203909] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.203909] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.203909] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.203909] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.203909] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 is going to be updated. [ 665.245254] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.245427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.245496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.246034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.246034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.258469] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 in Status: IN_PROGRESS for 2s [ 665.276249] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb in Status: SUCCESS [ 665.276465] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.287398] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.287771] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.287860] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.288149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.288440] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.288573] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.288639] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.288846] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.289557] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.289660] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.289771] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.456839] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.457050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.457050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.458484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.458484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.458484] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e is going to be updated. [ 665.488654] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.488795] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.489037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.489146] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.489292] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.499746] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e in Status: IN_PROGRESS for 2s [ 665.540530] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: SUCCESS [ 665.540760] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.795274] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.795274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.795274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.795274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.795274] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.795274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.795274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.795274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.795274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.795274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.795274] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.795274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.795274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.795274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.795274] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.795274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.798847] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.798847] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.798847] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.798847] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.798847] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.300799] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e65996f-05e7-4178-bdb9-30270bc56380: rpc.has_security_group_logging(os_id): False [ 666.322470] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.323503] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.323503] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.323503] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.323503] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.323503] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.323503] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.323503] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.323907] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.323907] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.324206] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.324206] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.324206] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.324320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.324387] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.324599] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.324675] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.324764] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.325435] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.325435] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.325435] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e65996f-05e7-4178-bdb9-30270bc56380 is going to be updated. [ 666.412026] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.412283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.412369] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.413207] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.413489] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.464070] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: IN_PROGRESS for 2s [ 667.269116] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 in Status: SUCCESS [ 667.269356] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 deletion is rescheduled due to dependency. [ 667.269554] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.535288] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e in Status: SUCCESS [ 667.535288] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.535288] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.535288] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.535288] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.535288] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.535288] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.535288] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.536011] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.536263] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.536630] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88219fc7-d04d-4a0f-88d0-399f8bd7ef8e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.810127] env[65322]: INFO networking_nsxv3.common.synchronization [req-72d30893-c6a2-49a6-ad59-461ebb1e2801 req-ed42890a-90a2-4cb6-86ef-3e15c4d55b9d tempest-ListImageFiltersTestJSON-1830232645 tempest-ListImageFiltersTestJSON-1830232645-project-member] Enqueued Resource ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 with Priority: HIGHEST for action security_group_members [ 667.810646] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 with Priority: HIGHEST for action security_group_members [ 667.811091] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.811254] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.811322] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.811577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.811740] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.811840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.811943] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.812062] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.812238] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.812238] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60b11f04-8768-43f5-bcb0-8bb51ec0bdf2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.043666] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.043666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.043666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.043666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.043666] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.043666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.043666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.043666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.043666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.043666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.043666] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.043666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.043666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.043666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.043666] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.043666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.044287] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.044287] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.044287] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.044287] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.044287] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88219fc7-d04d-4a0f-88d0-399f8bd7ef8e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.316778] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60b11f04-8768-43f5-bcb0-8bb51ec0bdf2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.482844] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: SUCCESS [ 668.482844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.546011] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e: rpc.has_security_group_logging(os_id): False [ 668.566351] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.566492] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.566536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.566770] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.566865] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.567116] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.567251] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.567330] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.567535] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.567627] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.567884] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.568087] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.568161] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.568310] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.568386] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.568591] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.568735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.568896] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.568963] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.569067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.569169] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e is going to be updated. [ 668.635381] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.635564] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.635640] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.635856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.635998] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.644409] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-620 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.644598] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.644711] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.644972] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.645263] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.645413] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.646051] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.646051] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.646051] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.646335] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.646506] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 668.646823] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 668.646823] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 668.648434] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.648617] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 668.648731] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 668.650384] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e in Status: IN_PROGRESS for 2s [ 668.668368] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 668.668533] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 668.668650] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 668.668818] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.669144] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-cbd2a302-3a58-4841-8fa9-75ec1373879c taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.669314] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-cbd2a302-3a58-4841-8fa9-75ec1373879c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.669441] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-cbd2a302-3a58-4841-8fa9-75ec1373879c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.669992] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-cbd2a302-3a58-4841-8fa9-75ec1373879c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.669992] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbd2a302-3a58-4841-8fa9-75ec1373879c',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.819626] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60b11f04-8768-43f5-bcb0-8bb51ec0bdf2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.172998] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.173195] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.173315] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.173593] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.174031] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.174216] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port cbd2a302-3a58-4841-8fa9-75ec1373879c not found, creating... [ 669.174493] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.174657] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.174882] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.175166] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.175304] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.175706] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.175803] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.175841] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.176267] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.176267] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.176421] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: cbd2a302-3a58-4841-8fa9-75ec1373879c is going to be created. [ 669.214852] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.218027] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.218027] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.218027] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.218027] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.218027] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-cbd2a302-3a58-4841-8fa9-75ec1373879c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.322655] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.322831] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.322905] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.323152] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.323236] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.323339] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 is going to be updated. [ 669.367370] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.367370] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.367767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.367767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.367903] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.373321] env[65322]: INFO networking_nsxv3.common.synchronization [None req-5295a954-139f-40ce-a354-f6dad293d068 None None] Enqueued Resource ID: c510dd72-fe2d-4125-9352-4fe5ca6b693e with Priority: HIGHEST for action port [ 669.373321] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c510dd72-fe2d-4125-9352-4fe5ca6b693e with Priority: HIGHEST for action port [ 669.373649] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-c510dd72-fe2d-4125-9352-4fe5ca6b693e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.373795] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c510dd72-fe2d-4125-9352-4fe5ca6b693e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.373897] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c510dd72-fe2d-4125-9352-4fe5ca6b693e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.374329] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c510dd72-fe2d-4125-9352-4fe5ca6b693e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.374447] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c510dd72-fe2d-4125-9352-4fe5ca6b693e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.386739] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 in Status: IN_PROGRESS for 2s [ 669.877878] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c510dd72-fe2d-4125-9352-4fe5ca6b693e [ 669.877878] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.877878] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.877878] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.877878] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.877878] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.877878] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c510dd72-fe2d-4125-9352-4fe5ca6b693e already deleted. [ 669.877878] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c510dd72-fe2d-4125-9352-4fe5ca6b693e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.904554] env[65322]: INFO networking_nsxv3.common.synchronization [req-72d30893-c6a2-49a6-ad59-461ebb1e2801 req-ea99168f-534d-41af-bff7-2d0db6393d3c service nova] Enqueued Resource ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 with Priority: HIGHEST for action security_group_rules [ 669.904554] env[65322]: INFO networking_nsxv3.common.synchronization [req-72d30893-c6a2-49a6-ad59-461ebb1e2801 req-ea99168f-534d-41af-bff7-2d0db6393d3c service nova] Enqueued Resource ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 with Priority: HIGHEST for action security_group_members [ 669.904554] env[65322]: INFO networking_nsxv3.common.synchronization [req-72d30893-c6a2-49a6-ad59-461ebb1e2801 req-ea99168f-534d-41af-bff7-2d0db6393d3c service nova] Enqueued Resource ID: cbd2a302-3a58-4841-8fa9-75ec1373879c with Priority: HIGHEST for action port [ 669.904554] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 with Priority: HIGHEST for action security_group_rules [ 669.904554] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 with Priority: HIGHEST for action security_group_members [ 669.904554] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbd2a302-3a58-4841-8fa9-75ec1373879c with Priority: HIGHEST for action port [ 669.904554] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.904554] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.904554] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.905288] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.905380] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60b11f04-8768-43f5-bcb0-8bb51ec0bdf2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.906444] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.906588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.906737] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbd2a302-3a58-4841-8fa9-75ec1373879c taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.907796] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbd2a302-3a58-4841-8fa9-75ec1373879c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.907796] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbd2a302-3a58-4841-8fa9-75ec1373879c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.907796] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbd2a302-3a58-4841-8fa9-75ec1373879c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.907796] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbd2a302-3a58-4841-8fa9-75ec1373879c',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.414035] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.414035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.414035] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cbd2a302-3a58-4841-8fa9-75ec1373879c with status ACTIVE [ 670.414035] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.414035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.414035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.414035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.414035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.414035] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.414035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.414035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.414035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.414035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.414035] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.415338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.415338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.415338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.415338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.415338] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cbd2a302-3a58-4841-8fa9-75ec1373879c is going to be updated. [ 670.438526] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.438526] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.438833] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.438833] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.439019] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.439997] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbd2a302-3a58-4841-8fa9-75ec1373879c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.677382] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e in Status: SUCCESS [ 670.677673] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.213494] env[65322]: INFO networking_nsxv3.common.synchronization [None req-a3e3fbb0-70b7-402c-aadc-8e22610fc42b None None] Enqueued Resource ID: 3f986620-a8c4-47b5-8e8a-d0ef4624c15f with Priority: HIGHEST for action port [ 671.214469] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f986620-a8c4-47b5-8e8a-d0ef4624c15f with Priority: HIGHEST for action port [ 671.215460] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f986620-a8c4-47b5-8e8a-d0ef4624c15f taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.215603] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f986620-a8c4-47b5-8e8a-d0ef4624c15f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.215648] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f986620-a8c4-47b5-8e8a-d0ef4624c15f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.216405] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f986620-a8c4-47b5-8e8a-d0ef4624c15f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.216405] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f986620-a8c4-47b5-8e8a-d0ef4624c15f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.400165] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 in Status: SUCCESS [ 671.400571] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.400913] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.405493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.405493] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.405493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.405493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.405493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.405493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.405493] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60b11f04-8768-43f5-bcb0-8bb51ec0bdf2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.443705] env[65322]: INFO networking_nsxv3.common.synchronization [req-ac9753f8-7edb-4baa-85e8-16d4d170bae4 req-f7019086-67be-49e0-a776-6bd7b4b03e0a tempest-InstanceActionsV221TestJSON-1847134158 tempest-InstanceActionsV221TestJSON-1847134158-project-member] Enqueued Resource ID: b782aecb-f199-4bcf-9857-f670ec188036 with Priority: HIGHEST for action security_group_members [ 671.445553] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b782aecb-f199-4bcf-9857-f670ec188036 with Priority: HIGHEST for action security_group_members [ 671.445904] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-b782aecb-f199-4bcf-9857-f670ec188036 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.446056] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.446123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.446387] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.446549] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.446650] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.446711] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.446859] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.446941] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.447048] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b782aecb-f199-4bcf-9857-f670ec188036',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.721180] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f986620-a8c4-47b5-8e8a-d0ef4624c15f [ 671.721290] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.721438] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.721531] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.721768] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.721858] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.721958] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f986620-a8c4-47b5-8e8a-d0ef4624c15f already deleted. [ 671.722051] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f986620-a8c4-47b5-8e8a-d0ef4624c15f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.905041] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60b11f04-8768-43f5-bcb0-8bb51ec0bdf2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.952106] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.952106] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.952106] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.952106] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.952106] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.952940] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.952940] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.952940] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.952940] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.952940] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.952940] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b782aecb-f199-4bcf-9857-f670ec188036 already deleted. [ 671.952940] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.076756] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-161 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.076756] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-161" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.076996] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-161" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.077344] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-161" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.077617] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.077762] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.077869] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.079092] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.080159] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.080159] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 672.080415] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 672.080415] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 672.080415] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 672.080541] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 672.080580] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 672.081092] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 672.102257] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 672.102614] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 672.102881] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 672.103266] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-161" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.103758] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-fb095388-04f5-463b-b39c-23d0b1ef76db taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.104248] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-fb095388-04f5-463b-b39c-23d0b1ef76db" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.104475] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-fb095388-04f5-463b-b39c-23d0b1ef76db" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.104898] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-fb095388-04f5-463b-b39c-23d0b1ef76db" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.105317] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb095388-04f5-463b-b39c-23d0b1ef76db',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.408926] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60b11f04-8768-43f5-bcb0-8bb51ec0bdf2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.609158] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.609428] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.609527] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.609841] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.609932] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.610191] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port fb095388-04f5-463b-b39c-23d0b1ef76db not found, creating... [ 672.610380] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.610545] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.610654] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.611051] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.611051] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.611315] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.613484] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.613484] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.613484] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.613484] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.613484] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: fb095388-04f5-463b-b39c-23d0b1ef76db is going to be created. [ 672.657206] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.657727] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.657832] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.658114] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.658379] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.658636] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-fb095388-04f5-463b-b39c-23d0b1ef76db" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.912594] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.912594] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.915110] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.918109] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.918337] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.918452] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 is going to be updated. [ 672.951247] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.951418] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.951547] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.951815] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.951912] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.964363] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 in Status: IN_PROGRESS for 2s [ 673.383886] env[65322]: INFO networking_nsxv3.common.synchronization [req-ac9753f8-7edb-4baa-85e8-16d4d170bae4 req-02a14ea3-8474-4da3-a632-4b8131e94987 service nova] Enqueued Resource ID: b782aecb-f199-4bcf-9857-f670ec188036 with Priority: HIGHEST for action security_group_rules [ 673.383983] env[65322]: INFO networking_nsxv3.common.synchronization [req-ac9753f8-7edb-4baa-85e8-16d4d170bae4 req-02a14ea3-8474-4da3-a632-4b8131e94987 service nova] Enqueued Resource ID: b782aecb-f199-4bcf-9857-f670ec188036 with Priority: HIGHEST for action security_group_members [ 673.384341] env[65322]: INFO networking_nsxv3.common.synchronization [req-ac9753f8-7edb-4baa-85e8-16d4d170bae4 req-02a14ea3-8474-4da3-a632-4b8131e94987 service nova] Enqueued Resource ID: fb095388-04f5-463b-b39c-23d0b1ef76db with Priority: HIGHEST for action port [ 673.384894] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b782aecb-f199-4bcf-9857-f670ec188036 with Priority: HIGHEST for action security_group_rules [ 673.385105] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b782aecb-f199-4bcf-9857-f670ec188036 with Priority: HIGHEST for action security_group_members [ 673.385495] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb095388-04f5-463b-b39c-23d0b1ef76db with Priority: HIGHEST for action port [ 673.385931] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b782aecb-f199-4bcf-9857-f670ec188036 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.386161] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.386252] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.386592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.386731] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b782aecb-f199-4bcf-9857-f670ec188036',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.387747] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-b782aecb-f199-4bcf-9857-f670ec188036 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.388759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.388759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.388759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.388759] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.388759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.388759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.388759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.388759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.388759] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b782aecb-f199-4bcf-9857-f670ec188036',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.389544] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb095388-04f5-463b-b39c-23d0b1ef76db taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.389655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb095388-04f5-463b-b39c-23d0b1ef76db" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.389709] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb095388-04f5-463b-b39c-23d0b1ef76db" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.390047] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb095388-04f5-463b-b39c-23d0b1ef76db" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.390047] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb095388-04f5-463b-b39c-23d0b1ef76db',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.589479] env[65322]: INFO networking_nsxv3.common.synchronization [None req-5e55e925-772b-42ba-85aa-def826280684 tempest-ServersTestBootFromVolume-325336493 tempest-ServersTestBootFromVolume-325336493-project-member] Enqueued Resource ID: 1d03ae1b-566c-4270-87f0-fce3e636d072 with Priority: HIGHEST for action security_group_rules [ 673.589479] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d03ae1b-566c-4270-87f0-fce3e636d072 with Priority: HIGHEST for action security_group_rules [ 673.592489] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d03ae1b-566c-4270-87f0-fce3e636d072 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.592489] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.592728] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.593601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.593601] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d03ae1b-566c-4270-87f0-fce3e636d072',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.786953] env[65322]: INFO networking_nsxv3.common.synchronization [None req-7ab1c689-57dd-4973-bd14-82a082f72921 tempest-ServersTestBootFromVolume-325336493 tempest-ServersTestBootFromVolume-325336493-project-member] Enqueued Resource ID: 1d03ae1b-566c-4270-87f0-fce3e636d072 with Priority: HIGHEST for action security_group_rules [ 673.787759] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d03ae1b-566c-4270-87f0-fce3e636d072 with Priority: HIGHEST for action security_group_rules [ 673.788224] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d03ae1b-566c-4270-87f0-fce3e636d072 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.788428] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.891643] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b782aecb-f199-4bcf-9857-f670ec188036',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.895973] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-b782aecb-f199-4bcf-9857-f670ec188036 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.895973] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.895973] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb095388-04f5-463b-b39c-23d0b1ef76db with status ACTIVE [ 673.895973] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.895973] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.895973] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.895973] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.895973] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.895973] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.895973] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.895973] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.895973] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.895973] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.895973] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.897063] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.897063] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.897063] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.897063] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.897063] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb095388-04f5-463b-b39c-23d0b1ef76db is going to be updated. [ 673.924847] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.925425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.925906] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.925906] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.925995] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.926149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb095388-04f5-463b-b39c-23d0b1ef76db" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.121446] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.121738] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.121817] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.122657] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.122657] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.122657] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d03ae1b-566c-4270-87f0-fce3e636d072 already deleted. [ 674.122657] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.122890] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.122965] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.123156] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d03ae1b-566c-4270-87f0-fce3e636d072',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.398829] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b782aecb-f199-4bcf-9857-f670ec188036',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.647301] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.649277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.649277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.649277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.649277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.649277] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d03ae1b-566c-4270-87f0-fce3e636d072 already deleted. [ 674.649277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.901812] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.902039] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.902039] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.902266] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.902359] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.904646] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b782aecb-f199-4bcf-9857-f670ec188036 is going to be created. [ 674.931979] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.932197] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.932252] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.932494] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.932686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.942921] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b782aecb-f199-4bcf-9857-f670ec188036 in Status: UNINITIALIZED for 2s [ 674.972342] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 in Status: SUCCESS [ 674.973211] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.973448] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.973807] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.974048] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.974200] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.974266] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.974468] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.975916] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.975916] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.975916] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60b11f04-8768-43f5-bcb0-8bb51ec0bdf2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.479698] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.483333] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.483499] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.483647] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.483842] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.483952] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.484027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.484191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.484278] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.484765] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.484765] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.484765] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.484765] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.485018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.485018] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.485018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.485150] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.485189] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.485263] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.485342] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.485429] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60b11f04-8768-43f5-bcb0-8bb51ec0bdf2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.662943] env[65322]: INFO networking_nsxv3.common.synchronization [req-68fc50b9-27ab-4de2-bac3-681da8cd7d92 req-637a03d6-e651-4cdc-b5f9-40d848f493c9 tempest-ImagesOneServerNegativeTestJSON-1972759635 tempest-ImagesOneServerNegativeTestJSON-1972759635-project-member] Enqueued Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGHEST for action security_group_members [ 675.663772] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGHEST for action security_group_members [ 675.664900] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1550bb0-c88b-4864-824e-b80ca3b52834 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.664900] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.664900] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.664900] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.664900] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.665231] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.665231] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.665357] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.665357] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.665507] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.992414] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2: rpc.has_security_group_logging(os_id): False [ 676.010922] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.011204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.011338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.011659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.011809] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.012067] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.012164] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.012164] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.012400] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.012474] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.012703] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.012775] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.012829] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.012983] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.014022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.014267] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.014469] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.014469] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.014738] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.014860] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.015102] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 is going to be updated. [ 676.083376] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.083594] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.083594] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.084527] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.084527] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.101114] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 in Status: IN_PROGRESS for 2s [ 676.168554] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.168768] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.168880] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.170224] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.170224] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.170224] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.170224] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.170224] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.170717] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.170717] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.170717] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1550bb0-c88b-4864-824e-b80ca3b52834 already deleted. [ 676.170717] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.535192] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-139 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.535398] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-139" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.535516] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-139" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.535848] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-139" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.536303] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.536478] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.536591] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.536857] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.536998] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.537213] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 676.537322] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 676.537465] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 676.537536] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 676.537640] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 676.537736] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 676.537858] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 676.559049] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 676.559274] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 676.559497] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 676.559680] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-139" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.559985] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-f1006978-1456-4cf9-b49b-ad0dc7c64a59 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.560168] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-f1006978-1456-4cf9-b49b-ad0dc7c64a59" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.560280] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-f1006978-1456-4cf9-b49b-ad0dc7c64a59" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.560595] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-f1006978-1456-4cf9-b49b-ad0dc7c64a59" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.560738] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1006978-1456-4cf9-b49b-ad0dc7c64a59',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.957068] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b782aecb-f199-4bcf-9857-f670ec188036 in Status: SUCCESS [ 676.957408] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.957530] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.957739] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.957950] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.958114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.958184] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.958309] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.958386] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.958471] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.958560] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b782aecb-f199-4bcf-9857-f670ec188036',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.063728] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.063957] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.064095] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.064532] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.064735] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.064887] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port f1006978-1456-4cf9-b49b-ad0dc7c64a59 not found, creating... [ 677.065230] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.065456] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.065582] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.065831] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.066017] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.066343] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.066547] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.066690] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.066916] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.067050] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.067198] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: f1006978-1456-4cf9-b49b-ad0dc7c64a59 is going to be created. [ 677.093311] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.093657] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.093843] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.094180] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.094407] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.094629] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-f1006978-1456-4cf9-b49b-ad0dc7c64a59" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.461630] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-b782aecb-f199-4bcf-9857-f670ec188036 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.461874] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.461949] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.462161] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.462338] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.462451] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.462534] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.462748] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.462845] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.462922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.463084] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-b782aecb-f199-4bcf-9857-f670ec188036 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.463183] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.463262] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.463377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.463510] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.463597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.463650] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.463790] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.463887] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.463974] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.464077] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b782aecb-f199-4bcf-9857-f670ec188036',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.546849] env[65322]: INFO networking_nsxv3.common.synchronization [None req-3020d9fe-0e60-433b-ba00-bc24cdfccdfb None None] Enqueued Resource ID: 5f45457d-fe0c-4c11-927f-71416e00923d with Priority: HIGHEST for action port [ 677.547111] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f45457d-fe0c-4c11-927f-71416e00923d with Priority: HIGHEST for action port [ 677.547805] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f45457d-fe0c-4c11-927f-71416e00923d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.547805] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f45457d-fe0c-4c11-927f-71416e00923d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.547898] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f45457d-fe0c-4c11-927f-71416e00923d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.548119] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f45457d-fe0c-4c11-927f-71416e00923d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.548207] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f45457d-fe0c-4c11-927f-71416e00923d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.836362] env[65322]: INFO networking_nsxv3.common.synchronization [req-68fc50b9-27ab-4de2-bac3-681da8cd7d92 req-e4b46a4a-b85a-4ae2-8423-4cb9d295ca93 service nova] Enqueued Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGHEST for action security_group_rules [ 677.836589] env[65322]: INFO networking_nsxv3.common.synchronization [req-68fc50b9-27ab-4de2-bac3-681da8cd7d92 req-e4b46a4a-b85a-4ae2-8423-4cb9d295ca93 service nova] Enqueued Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGHEST for action security_group_members [ 677.836650] env[65322]: INFO networking_nsxv3.common.synchronization [req-68fc50b9-27ab-4de2-bac3-681da8cd7d92 req-e4b46a4a-b85a-4ae2-8423-4cb9d295ca93 service nova] Enqueued Resource ID: f1006978-1456-4cf9-b49b-ad0dc7c64a59 with Priority: HIGHEST for action port [ 677.837501] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGHEST for action security_group_rules [ 677.837829] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGHEST for action security_group_members [ 677.837938] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1006978-1456-4cf9-b49b-ad0dc7c64a59 with Priority: HIGHEST for action port [ 677.838235] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1550bb0-c88b-4864-824e-b80ca3b52834 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.838369] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.838435] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.838697] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.838782] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.840189] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1550bb0-c88b-4864-824e-b80ca3b52834 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.840348] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.840442] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.840692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.840895] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.842320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.842320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.842320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.842454] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.842512] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.843368] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1006978-1456-4cf9-b49b-ad0dc7c64a59 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.843480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1006978-1456-4cf9-b49b-ad0dc7c64a59" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.843550] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1006978-1456-4cf9-b49b-ad0dc7c64a59" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.843695] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1006978-1456-4cf9-b49b-ad0dc7c64a59" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.843765] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1006978-1456-4cf9-b49b-ad0dc7c64a59',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.966959] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b782aecb-f199-4bcf-9857-f670ec188036: rpc.has_security_group_logging(os_id): False [ 677.988626] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.988833] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.988883] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.990374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.990374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.990374] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.990374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.990374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.990374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.990374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.990374] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.990374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.990374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.990374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.990374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.990913] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.990913] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.990913] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.990913] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.990913] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.991103] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b782aecb-f199-4bcf-9857-f670ec188036 is going to be created. [ 678.051998] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f45457d-fe0c-4c11-927f-71416e00923d [ 678.052238] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.053503] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.053650] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.053884] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.053969] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.054089] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f45457d-fe0c-4c11-927f-71416e00923d already deleted. [ 678.054166] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f45457d-fe0c-4c11-927f-71416e00923d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.069531] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.069694] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.069768] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.070023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.070204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.085697] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b782aecb-f199-4bcf-9857-f670ec188036 in Status: IN_PROGRESS for 2s [ 678.117724] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 in Status: SUCCESS [ 678.117958] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.345879] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.347115] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1550bb0-c88b-4864-824e-b80ca3b52834 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.347282] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.347485] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1006978-1456-4cf9-b49b-ad0dc7c64a59 with status ACTIVE [ 678.347739] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.347858] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.347921] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.348142] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.348254] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.348398] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.348839] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.348839] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.351034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.351034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.351450] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.351450] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.351450] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.351450] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.351655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.352586] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1006978-1456-4cf9-b49b-ad0dc7c64a59 is going to be updated. [ 678.376721] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.376900] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.376965] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.377883] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.378109] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.378405] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1006978-1456-4cf9-b49b-ad0dc7c64a59" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.617798] env[65322]: INFO networking_nsxv3.common.synchronization [None req-e3dc0d9b-1562-44a6-b8fc-72e0b6ee7dc4 None None] Enqueued Resource ID: 230e8f45-c2d1-447c-829f-c118010169c0 with Priority: HIGHEST for action port [ 678.618025] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 230e8f45-c2d1-447c-829f-c118010169c0 with Priority: HIGHEST for action port [ 678.618336] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-230e8f45-c2d1-447c-829f-c118010169c0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.618456] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-230e8f45-c2d1-447c-829f-c118010169c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.618536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-230e8f45-c2d1-447c-829f-c118010169c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.618846] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-230e8f45-c2d1-447c-829f-c118010169c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.619462] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('230e8f45-c2d1-447c-829f-c118010169c0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.856558] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.123121] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 230e8f45-c2d1-447c-829f-c118010169c0 [ 679.123733] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.124387] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.124601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.125116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.125388] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.125529] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:230e8f45-c2d1-447c-829f-c118010169c0 already deleted. [ 679.125648] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-230e8f45-c2d1-447c-829f-c118010169c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.361201] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.361201] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.361201] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.361428] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.361555] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.361669] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1550bb0-c88b-4864-824e-b80ca3b52834 is going to be created. [ 679.391315] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.391315] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.391315] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.391315] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.391315] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.404901] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1550bb0-c88b-4864-824e-b80ca3b52834 in Status: UNINITIALIZED for 2s [ 679.764028] env[65322]: INFO networking_nsxv3.common.synchronization [None req-a151e124-2e47-45ce-b99b-19c156cd79d7 None None] Enqueued Resource ID: 30af3cbf-1289-4fd7-8882-95ad531e00cb with Priority: HIGHEST for action port [ 679.764508] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30af3cbf-1289-4fd7-8882-95ad531e00cb with Priority: HIGHEST for action port [ 679.764955] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-30af3cbf-1289-4fd7-8882-95ad531e00cb taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.765159] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30af3cbf-1289-4fd7-8882-95ad531e00cb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.765271] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30af3cbf-1289-4fd7-8882-95ad531e00cb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.765664] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30af3cbf-1289-4fd7-8882-95ad531e00cb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.765760] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30af3cbf-1289-4fd7-8882-95ad531e00cb',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.105807] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b782aecb-f199-4bcf-9857-f670ec188036 in Status: SUCCESS [ 680.106112] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.270481] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30af3cbf-1289-4fd7-8882-95ad531e00cb [ 680.270791] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.270974] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.270974] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.273578] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.273578] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.273578] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30af3cbf-1289-4fd7-8882-95ad531e00cb already deleted. [ 680.273578] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30af3cbf-1289-4fd7-8882-95ad531e00cb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.421525] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1550bb0-c88b-4864-824e-b80ca3b52834 in Status: SUCCESS [ 681.421859] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.422455] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.422455] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.424877] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.424877] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.424877] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.424877] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.424877] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.424877] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.424877] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.717294] env[65322]: INFO networking_nsxv3.common.synchronization [None req-0be94b1f-4bb4-4291-b25c-c525f8fbc2d9 None None] Enqueued Resource ID: 1396c606-9714-459e-b9dd-cb208b31a411 with Priority: HIGHEST for action port [ 681.717722] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1396c606-9714-459e-b9dd-cb208b31a411 with Priority: HIGHEST for action port [ 681.720904] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-1396c606-9714-459e-b9dd-cb208b31a411 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.721111] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1396c606-9714-459e-b9dd-cb208b31a411" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.721257] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1396c606-9714-459e-b9dd-cb208b31a411" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.721579] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1396c606-9714-459e-b9dd-cb208b31a411" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.721669] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1396c606-9714-459e-b9dd-cb208b31a411',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.931251] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1550bb0-c88b-4864-824e-b80ca3b52834 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.931530] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.931530] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.931668] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.931932] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.932039] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.932093] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.932271] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.932382] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.932501] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.932916] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1550bb0-c88b-4864-824e-b80ca3b52834 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.932916] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.932916] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.933136] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.933281] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.933351] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.933403] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.933558] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.933624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.933728] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.933846] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.225301] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1396c606-9714-459e-b9dd-cb208b31a411 [ 682.225301] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.225301] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.225301] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.225742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.225742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.225742] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1396c606-9714-459e-b9dd-cb208b31a411 already deleted. [ 682.225742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1396c606-9714-459e-b9dd-cb208b31a411" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.437858] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1550bb0-c88b-4864-824e-b80ca3b52834: rpc.has_security_group_logging(os_id): False [ 682.457139] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.457665] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.457857] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.458971] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.458971] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.458971] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.458971] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.458971] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.458971] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.458971] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.459378] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.459378] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.459378] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.459518] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.459612] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.459759] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.460276] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.460347] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.460499] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.460585] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.460658] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1550bb0-c88b-4864-824e-b80ca3b52834 is going to be created. [ 682.524568] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.524568] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.524568] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.524568] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.524568] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.537816] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1550bb0-c88b-4864-824e-b80ca3b52834 in Status: IN_PROGRESS for 2s [ 683.023399] env[65322]: INFO networking_nsxv3.common.synchronization [None req-37ef7846-b0c0-4222-8f2e-67e0e11a2506 None None] Enqueued Resource ID: 599d3d05-620a-43cc-8a6b-fae6ba62f5af with Priority: HIGHEST for action port [ 683.024081] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 599d3d05-620a-43cc-8a6b-fae6ba62f5af with Priority: HIGHEST for action port [ 683.024481] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-599d3d05-620a-43cc-8a6b-fae6ba62f5af taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.024647] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-599d3d05-620a-43cc-8a6b-fae6ba62f5af" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.024913] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-599d3d05-620a-43cc-8a6b-fae6ba62f5af" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.025082] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-599d3d05-620a-43cc-8a6b-fae6ba62f5af" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.025288] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('599d3d05-620a-43cc-8a6b-fae6ba62f5af',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.527508] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 599d3d05-620a-43cc-8a6b-fae6ba62f5af [ 683.527929] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.528052] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.528160] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.528423] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.528552] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.528670] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:599d3d05-620a-43cc-8a6b-fae6ba62f5af already deleted. [ 683.528791] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-599d3d05-620a-43cc-8a6b-fae6ba62f5af" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.563499] env[65322]: INFO networking_nsxv3.common.synchronization [req-8b4a3fc7-95a0-49bc-8e3a-7bad4230665a req-df2abb1d-bf99-4976-b4e9-d4fc288caaa3 tempest-ImagesTestJSON-2080608290 tempest-ImagesTestJSON-2080608290-project-member] Enqueued Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 683.564437] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 683.564786] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.564914] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.564983] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.566153] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.566556] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.566629] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.566754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.566979] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.567135] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.567667] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.064393] env[65322]: INFO networking_nsxv3.common.synchronization [None req-9081d581-f090-4dda-9f33-2cd71a8d8f35 None None] Enqueued Resource ID: b678da3b-d56a-4963-9cda-ffdabecc99da with Priority: HIGHEST for action port [ 684.064393] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b678da3b-d56a-4963-9cda-ffdabecc99da with Priority: HIGHEST for action port [ 684.064557] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-b678da3b-d56a-4963-9cda-ffdabecc99da taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.064557] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b678da3b-d56a-4963-9cda-ffdabecc99da" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.064698] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b678da3b-d56a-4963-9cda-ffdabecc99da" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.065964] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b678da3b-d56a-4963-9cda-ffdabecc99da" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.065964] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b678da3b-d56a-4963-9cda-ffdabecc99da',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.069359] env[65322]: INFO networking_nsxv3.common.synchronization [req-ce7444b4-c956-4a0e-8119-fc84cdca3a91 req-bd4a1323-deeb-4afa-a350-1595854a4b1a tempest-FloatingIPsAssociationNegativeTestJSON-1237424454 tempest-FloatingIPsAssociationNegativeTestJSON-1237424454-project-member] Enqueued Resource ID: 9d816765-57fa-4e08-a1ce-762a921d5096 with Priority: HIGHEST for action security_group_members [ 684.069359] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d816765-57fa-4e08-a1ce-762a921d5096 with Priority: HIGHEST for action security_group_members [ 684.070164] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d816765-57fa-4e08-a1ce-762a921d5096 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.070164] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.070357] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.071253] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.071253] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.071253] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.071253] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.071253] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.071449] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.071485] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d816765-57fa-4e08-a1ce-762a921d5096',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.075488] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.077022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.077022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.077476] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.077476] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.077776] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.078001] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.078071] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.078350] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.078469] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.078615] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 is going to be updated. [ 684.140338] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.140338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.140338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.140338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.140338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.154872] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: IN_PROGRESS for 2s [ 684.373286] env[65322]: INFO networking_nsxv3.common.synchronization [req-324c43e8-9a54-410f-939b-99c680fcb9b0 req-52d345d0-c289-4018-9b9a-7834e872c3f9 tempest-ServerExternalEventsTest-475623796 tempest-ServerExternalEventsTest-475623796-project-member] Enqueued Resource ID: 8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd with Priority: HIGHEST for action security_group_members [ 684.373882] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd with Priority: HIGHEST for action security_group_members [ 684.374263] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.374398] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.374462] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.374699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.374814] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.374903] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.374961] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.375136] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.375218] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.375317] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.552055] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1550bb0-c88b-4864-824e-b80ca3b52834 in Status: SUCCESS [ 684.552473] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.569891] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b678da3b-d56a-4963-9cda-ffdabecc99da [ 684.572130] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.573161] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.573161] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.573161] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.573161] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.573161] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b678da3b-d56a-4963-9cda-ffdabecc99da already deleted. [ 684.573161] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b678da3b-d56a-4963-9cda-ffdabecc99da" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.581871] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.582105] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.582105] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.582326] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.582421] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.582935] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.583046] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.583095] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.583250] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.583334] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.583429] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d816765-57fa-4e08-a1ce-762a921d5096 is going to be updated. [ 684.625128] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.625128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.625128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.625128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.625128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.637598] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d816765-57fa-4e08-a1ce-762a921d5096 in Status: IN_PROGRESS for 2s [ 684.877658] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.877807] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.878139] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.878139] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.878276] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.878502] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.878632] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.878715] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.878969] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.879217] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.879298] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd is going to be updated. [ 684.914174] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.914361] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.914399] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.916314] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.916314] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.925290] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd in Status: IN_PROGRESS for 2s [ 685.748344] env[65322]: INFO networking_nsxv3.common.synchronization [None req-987e1306-9877-48e0-ba77-e794470328f8 tempest-ServerActionsV293TestJSON-768711526 tempest-ServerActionsV293TestJSON-768711526-project-member] Enqueued Resource ID: aa7cb676-7b51-4e93-980a-5540e7a7e88b with Priority: HIGHEST for action security_group_rules [ 685.749254] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7cb676-7b51-4e93-980a-5540e7a7e88b with Priority: HIGHEST for action security_group_rules [ 685.749302] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa7cb676-7b51-4e93-980a-5540e7a7e88b taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.749397] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.749525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.750511] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.751209] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa7cb676-7b51-4e93-980a-5540e7a7e88b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.872902] env[65322]: INFO networking_nsxv3.common.synchronization [None req-3f139e84-a0e3-4637-97ef-5438bb00e67d tempest-ServerActionsV293TestJSON-768711526 tempest-ServerActionsV293TestJSON-768711526-project-member] Enqueued Resource ID: aa7cb676-7b51-4e93-980a-5540e7a7e88b with Priority: HIGHEST for action security_group_rules [ 685.872902] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7cb676-7b51-4e93-980a-5540e7a7e88b with Priority: HIGHEST for action security_group_rules [ 685.872902] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa7cb676-7b51-4e93-980a-5540e7a7e88b taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.872902] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.167556] env[65322]: INFO networking_nsxv3.common.synchronization [None req-abe50c0b-bd54-4ea7-834b-c020500a5289 None None] Enqueued Resource ID: b233a7a3-9c22-40c9-ad6a-793de9e4e44a with Priority: HIGHEST for action port [ 686.168249] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b233a7a3-9c22-40c9-ad6a-793de9e4e44a with Priority: HIGHEST for action port [ 686.169986] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: SUCCESS [ 686.170809] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 deletion is rescheduled due to dependency. [ 686.170965] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.171322] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-b233a7a3-9c22-40c9-ad6a-793de9e4e44a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.171509] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b233a7a3-9c22-40c9-ad6a-793de9e4e44a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.171635] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b233a7a3-9c22-40c9-ad6a-793de9e4e44a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.172232] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b233a7a3-9c22-40c9-ad6a-793de9e4e44a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.172232] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b233a7a3-9c22-40c9-ad6a-793de9e4e44a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.274302] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.274479] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.274556] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.275525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.275525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.275648] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa7cb676-7b51-4e93-980a-5540e7a7e88b already deleted. [ 686.275767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.276050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.276307] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.276453] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa7cb676-7b51-4e93-980a-5540e7a7e88b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.650117] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d816765-57fa-4e08-a1ce-762a921d5096 in Status: SUCCESS [ 686.650117] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d816765-57fa-4e08-a1ce-762a921d5096 deletion is rescheduled due to dependency. [ 686.650117] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.677337] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b233a7a3-9c22-40c9-ad6a-793de9e4e44a [ 686.677337] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.677337] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.677337] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.677337] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.677337] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.677337] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b233a7a3-9c22-40c9-ad6a-793de9e4e44a already deleted. [ 686.677337] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b233a7a3-9c22-40c9-ad6a-793de9e4e44a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.799281] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.799713] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.799713] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.799835] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.799879] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.799952] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa7cb676-7b51-4e93-980a-5540e7a7e88b already deleted. [ 686.800415] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.939939] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd in Status: SUCCESS [ 686.940016] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd deletion is rescheduled due to dependency. [ 686.940121] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.257185] env[65322]: INFO networking_nsxv3.common.synchronization [None req-e4c6637e-27ab-40b1-8cec-f53d4b01000b tempest-ServerActionsTestOtherA-1162989957 tempest-ServerActionsTestOtherA-1162989957-project-member] Enqueued Resource ID: e4dca03f-65fb-4951-910c-8904302d70fa with Priority: HIGHEST for action security_group_rules [ 688.257831] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4dca03f-65fb-4951-910c-8904302d70fa with Priority: HIGHEST for action security_group_rules [ 688.258041] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4dca03f-65fb-4951-910c-8904302d70fa taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.258169] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.258236] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.258952] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.258952] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4dca03f-65fb-4951-910c-8904302d70fa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.725829] env[65322]: INFO networking_nsxv3.common.synchronization [None req-07a91bfe-0eb1-405c-8b2e-3e7ef8b5f30d None None] Enqueued Resource ID: 6d5e924c-5fb6-48ce-be99-96eb58cbaa85 with Priority: HIGHEST for action port [ 688.726579] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d5e924c-5fb6-48ce-be99-96eb58cbaa85 with Priority: HIGHEST for action port [ 688.728388] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d5e924c-5fb6-48ce-be99-96eb58cbaa85 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.728388] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d5e924c-5fb6-48ce-be99-96eb58cbaa85" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.728388] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d5e924c-5fb6-48ce-be99-96eb58cbaa85" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.728388] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d5e924c-5fb6-48ce-be99-96eb58cbaa85" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.728388] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d5e924c-5fb6-48ce-be99-96eb58cbaa85',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.737955] env[65322]: INFO networking_nsxv3.common.synchronization [None req-c22c87c7-72fe-4612-837a-75b7c1528537 tempest-ServerActionsTestOtherA-1162989957 tempest-ServerActionsTestOtherA-1162989957-project-member] Enqueued Resource ID: e4dca03f-65fb-4951-910c-8904302d70fa with Priority: HIGHEST for action security_group_rules [ 688.738716] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4dca03f-65fb-4951-910c-8904302d70fa with Priority: HIGHEST for action security_group_rules [ 688.739119] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4dca03f-65fb-4951-910c-8904302d70fa taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.739243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.801788] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.801788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.801788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.801788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.801788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.801788] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4dca03f-65fb-4951-910c-8904302d70fa already deleted. [ 688.802276] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.802276] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.802276] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.802378] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4dca03f-65fb-4951-910c-8904302d70fa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.163548] env[65322]: INFO networking_nsxv3.common.synchronization [None req-a3359323-7d20-4147-9afc-300edfed4b7b None None] Enqueued Resource ID: bf079f83-bee5-43aa-852b-7d8a773b6004 with Priority: HIGHEST for action port [ 689.164131] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf079f83-bee5-43aa-852b-7d8a773b6004 with Priority: HIGHEST for action port [ 689.165290] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf079f83-bee5-43aa-852b-7d8a773b6004 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.165290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf079f83-bee5-43aa-852b-7d8a773b6004" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.165290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf079f83-bee5-43aa-852b-7d8a773b6004" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.165290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf079f83-bee5-43aa-852b-7d8a773b6004" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.165290] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf079f83-bee5-43aa-852b-7d8a773b6004',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.230406] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d5e924c-5fb6-48ce-be99-96eb58cbaa85 [ 689.230716] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.230874] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.230937] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.231191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.231296] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.231526] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d5e924c-5fb6-48ce-be99-96eb58cbaa85 already deleted. [ 689.231526] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d5e924c-5fb6-48ce-be99-96eb58cbaa85" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.329341] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.332019] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.332019] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.332019] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.332019] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.332019] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4dca03f-65fb-4951-910c-8904302d70fa already deleted. [ 689.332272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.498086] env[65322]: INFO networking_nsxv3.common.synchronization [None req-61886f73-7edd-4735-9720-0ed2faed1630 None None] Enqueued Resource ID: 1e298806-d1e3-4996-9778-1813d6c4fa0f with Priority: HIGHEST for action port [ 689.498086] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e298806-d1e3-4996-9778-1813d6c4fa0f with Priority: HIGHEST for action port [ 689.498086] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e298806-d1e3-4996-9778-1813d6c4fa0f taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.498086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e298806-d1e3-4996-9778-1813d6c4fa0f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.498086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e298806-d1e3-4996-9778-1813d6c4fa0f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.498086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e298806-d1e3-4996-9778-1813d6c4fa0f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.498086] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e298806-d1e3-4996-9778-1813d6c4fa0f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.668280] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bf079f83-bee5-43aa-852b-7d8a773b6004 [ 689.668280] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.668280] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.668280] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.668280] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.668280] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.668280] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bf079f83-bee5-43aa-852b-7d8a773b6004 already deleted. [ 689.668280] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf079f83-bee5-43aa-852b-7d8a773b6004" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.028357] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1e298806-d1e3-4996-9778-1813d6c4fa0f [ 690.028357] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.028357] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.028357] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.028357] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.028930] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.028930] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1e298806-d1e3-4996-9778-1813d6c4fa0f already deleted. [ 690.028930] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e298806-d1e3-4996-9778-1813d6c4fa0f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.553471] env[65322]: INFO networking_nsxv3.common.synchronization [None req-dd584d2f-cda4-43c1-a803-e616ee733805 tempest-ServersTestFqdnHostnames-1357520545 tempest-ServersTestFqdnHostnames-1357520545-project-member] Enqueued Resource ID: b43d5c58-0cb4-4f14-b009-7fe58147ee41 with Priority: HIGHEST for action security_group_rules [ 690.554477] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b43d5c58-0cb4-4f14-b009-7fe58147ee41 with Priority: HIGHEST for action security_group_rules [ 690.554845] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b43d5c58-0cb4-4f14-b009-7fe58147ee41 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.554968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.555100] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.555496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.555647] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b43d5c58-0cb4-4f14-b009-7fe58147ee41',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.876501] env[65322]: INFO networking_nsxv3.common.synchronization [None req-7fe39305-103a-46fb-9c11-7bb480b0f69e tempest-ServersTestFqdnHostnames-1357520545 tempest-ServersTestFqdnHostnames-1357520545-project-member] Enqueued Resource ID: b43d5c58-0cb4-4f14-b009-7fe58147ee41 with Priority: HIGHEST for action security_group_rules [ 690.876501] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b43d5c58-0cb4-4f14-b009-7fe58147ee41 with Priority: HIGHEST for action security_group_rules [ 690.876501] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b43d5c58-0cb4-4f14-b009-7fe58147ee41 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.876501] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.081788] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.081966] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.082254] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.082254] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.082383] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.082738] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b43d5c58-0cb4-4f14-b009-7fe58147ee41 already deleted. [ 691.082738] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.082738] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.082890] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.082974] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b43d5c58-0cb4-4f14-b009-7fe58147ee41',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.609348] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.609690] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.609690] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.609884] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.609999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.610111] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b43d5c58-0cb4-4f14-b009-7fe58147ee41 already deleted. [ 691.610191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.995221] env[65322]: INFO networking_nsxv3.common.synchronization [None req-812c6a2a-92a4-4547-ac7c-d3083ad76084 tempest-MigrationsAdminTest-1504175931 tempest-MigrationsAdminTest-1504175931-project-member] Enqueued Resource ID: aa20511c-e55e-4822-82df-e0df0481bb9a with Priority: HIGHEST for action security_group_rules [ 691.998864] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa20511c-e55e-4822-82df-e0df0481bb9a with Priority: HIGHEST for action security_group_rules [ 691.999302] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa20511c-e55e-4822-82df-e0df0481bb9a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.000034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa20511c-e55e-4822-82df-e0df0481bb9a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.000034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa20511c-e55e-4822-82df-e0df0481bb9a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.000034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa20511c-e55e-4822-82df-e0df0481bb9a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.000034] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa20511c-e55e-4822-82df-e0df0481bb9a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.143442] env[65322]: INFO networking_nsxv3.common.synchronization [None req-87303521-3a1e-40c5-bd2d-ac40344e8632 tempest-MigrationsAdminTest-1504175931 tempest-MigrationsAdminTest-1504175931-project-member] Enqueued Resource ID: aa20511c-e55e-4822-82df-e0df0481bb9a with Priority: HIGHEST for action security_group_rules [ 692.144040] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa20511c-e55e-4822-82df-e0df0481bb9a with Priority: HIGHEST for action security_group_rules [ 692.144372] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa20511c-e55e-4822-82df-e0df0481bb9a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.144518] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa20511c-e55e-4822-82df-e0df0481bb9a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.521742] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.522058] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.522058] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.522413] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.522413] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.523357] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa20511c-e55e-4822-82df-e0df0481bb9a already deleted. [ 692.523357] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa20511c-e55e-4822-82df-e0df0481bb9a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.528781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa20511c-e55e-4822-82df-e0df0481bb9a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.528781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa20511c-e55e-4822-82df-e0df0481bb9a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.528781] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa20511c-e55e-4822-82df-e0df0481bb9a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.872496] env[65322]: INFO networking_nsxv3.common.synchronization [None req-e73e430e-40f2-4ee6-aadc-24c6077edb45 tempest-ServerActionsTestOtherB-30032286 tempest-ServerActionsTestOtherB-30032286-project-member] Enqueued Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_rules [ 692.872831] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_rules [ 692.872945] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c552e7e9-dc55-4efc-afb8-91a443d0679a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.874801] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.874801] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.875141] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.875228] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.048876] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.049110] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.049110] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.049667] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.049667] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.049667] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa20511c-e55e-4822-82df-e0df0481bb9a already deleted. [ 693.049667] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa20511c-e55e-4822-82df-e0df0481bb9a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.153696] env[65322]: INFO networking_nsxv3.common.synchronization [None req-030eceb3-0772-4954-8044-df080b36dc72 tempest-ServerActionsTestOtherB-30032286 tempest-ServerActionsTestOtherB-30032286-project-member] Enqueued Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_rules [ 693.154554] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_rules [ 693.155032] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c552e7e9-dc55-4efc-afb8-91a443d0679a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.155148] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.250058] env[65322]: INFO networking_nsxv3.common.synchronization [None req-0ce172cb-78f9-4ffd-8c86-70b960935825 None None] Enqueued Resource ID: c0bdfd60-a197-4c14-89c3-1672b7788db5 with Priority: HIGHEST for action port [ 693.250526] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0bdfd60-a197-4c14-89c3-1672b7788db5 with Priority: HIGHEST for action port [ 693.251266] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0bdfd60-a197-4c14-89c3-1672b7788db5 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.251589] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0bdfd60-a197-4c14-89c3-1672b7788db5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.251920] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0bdfd60-a197-4c14-89c3-1672b7788db5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.254082] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0bdfd60-a197-4c14-89c3-1672b7788db5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.254082] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0bdfd60-a197-4c14-89c3-1672b7788db5',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.402850] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.402850] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.402850] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.402850] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.402850] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.402850] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c552e7e9-dc55-4efc-afb8-91a443d0679a already deleted. [ 693.402850] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.403673] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.404776] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.404776] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.476108] env[65322]: INFO networking_nsxv3.common.synchronization [None req-12b93c67-1989-4631-a034-047e90b8ddb0 None None] Enqueued Resource ID: 5f934e56-7ec9-48e5-8246-a3006dd5ccae with Priority: HIGHEST for action port [ 693.476930] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f934e56-7ec9-48e5-8246-a3006dd5ccae with Priority: HIGHEST for action port [ 693.477263] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f934e56-7ec9-48e5-8246-a3006dd5ccae taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.477377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f934e56-7ec9-48e5-8246-a3006dd5ccae" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.477640] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f934e56-7ec9-48e5-8246-a3006dd5ccae" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.477868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f934e56-7ec9-48e5-8246-a3006dd5ccae" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.477955] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f934e56-7ec9-48e5-8246-a3006dd5ccae',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.754338] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c0bdfd60-a197-4c14-89c3-1672b7788db5 [ 693.754540] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.754681] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.754779] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.755070] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.755163] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.755263] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c0bdfd60-a197-4c14-89c3-1672b7788db5 already deleted. [ 693.755350] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0bdfd60-a197-4c14-89c3-1672b7788db5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.928669] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.929066] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.929066] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.929535] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.929535] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.929724] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c552e7e9-dc55-4efc-afb8-91a443d0679a already deleted. [ 693.929937] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.981173] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f934e56-7ec9-48e5-8246-a3006dd5ccae [ 693.981439] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.981586] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.981681] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.981904] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.982595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.982595] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f934e56-7ec9-48e5-8246-a3006dd5ccae already deleted. [ 693.982595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f934e56-7ec9-48e5-8246-a3006dd5ccae" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.819607] env[65322]: INFO networking_nsxv3.common.synchronization [None req-0c32fa11-27f5-4764-8367-f4bd11fa068e None None] Enqueued Resource ID: bb97f10b-e101-4072-b34c-e909de5622ca with Priority: HIGHEST for action port [ 694.820230] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb97f10b-e101-4072-b34c-e909de5622ca with Priority: HIGHEST for action port [ 694.820606] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb97f10b-e101-4072-b34c-e909de5622ca taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.820734] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb97f10b-e101-4072-b34c-e909de5622ca" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.820806] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb97f10b-e101-4072-b34c-e909de5622ca" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.821890] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb97f10b-e101-4072-b34c-e909de5622ca" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.821890] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb97f10b-e101-4072-b34c-e909de5622ca',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.324028] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb97f10b-e101-4072-b34c-e909de5622ca [ 695.325040] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.325040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.325202] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.325381] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.325505] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.325619] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb97f10b-e101-4072-b34c-e909de5622ca already deleted. [ 695.325712] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb97f10b-e101-4072-b34c-e909de5622ca" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.514983] env[65322]: INFO networking_nsxv3.common.synchronization [req-1633bc76-3802-488a-891e-d05e9282005f req-1d9141f2-a0b6-45ab-ba96-1193930967d6 tempest-InstanceActionsV221TestJSON-1847134158 tempest-InstanceActionsV221TestJSON-1847134158-project-member] Enqueued Resource ID: b782aecb-f199-4bcf-9857-f670ec188036 with Priority: HIGHEST for action security_group_members [ 697.517634] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b782aecb-f199-4bcf-9857-f670ec188036 with Priority: HIGHEST for action security_group_members [ 697.518241] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-b782aecb-f199-4bcf-9857-f670ec188036 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.518430] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.518504] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.518781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.518963] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.519079] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.519140] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.519294] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.519432] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.519498] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b782aecb-f199-4bcf-9857-f670ec188036',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.025675] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.025675] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.025896] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.026034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.026112] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.026398] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.026530] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.026530] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.026693] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.026693] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.026862] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b782aecb-f199-4bcf-9857-f670ec188036 is going to be updated. [ 698.052672] env[65322]: INFO networking_nsxv3.common.synchronization [None req-7ea65155-828f-49ac-a165-61cee594d5a0 None None] Enqueued Resource ID: 1033c2db-70fa-4470-8dc3-fc46c29ee3a0 with Priority: HIGHEST for action port [ 698.053258] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1033c2db-70fa-4470-8dc3-fc46c29ee3a0 with Priority: HIGHEST for action port [ 698.053600] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-1033c2db-70fa-4470-8dc3-fc46c29ee3a0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.053908] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1033c2db-70fa-4470-8dc3-fc46c29ee3a0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.053908] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1033c2db-70fa-4470-8dc3-fc46c29ee3a0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.055841] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1033c2db-70fa-4470-8dc3-fc46c29ee3a0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.055950] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1033c2db-70fa-4470-8dc3-fc46c29ee3a0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.067915] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.067915] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.067915] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.068176] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.068406] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.081896] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b782aecb-f199-4bcf-9857-f670ec188036 in Status: IN_PROGRESS for 2s [ 698.558114] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1033c2db-70fa-4470-8dc3-fc46c29ee3a0 [ 698.558375] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.558598] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.558598] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.560565] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.560660] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.560788] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1033c2db-70fa-4470-8dc3-fc46c29ee3a0 already deleted. [ 698.560886] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1033c2db-70fa-4470-8dc3-fc46c29ee3a0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.913905] env[65322]: INFO networking_nsxv3.common.synchronization [req-0c674834-b055-4779-9e68-16bdc278842b req-c284c0b4-5dc7-4853-b33d-7d7b2e8ce715 tempest-AttachInterfacesUnderV243Test-1887082716 tempest-AttachInterfacesUnderV243Test-1887082716-project-member] Enqueued Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGHEST for action security_group_members [ 698.914373] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGHEST for action security_group_members [ 698.914647] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-02830029-f973-4892-9d06-f25f8aee730a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.914794] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.914857] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.915028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.915316] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.915316] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.915316] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.915609] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.915609] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.915823] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.939789] env[65322]: INFO networking_nsxv3.common.synchronization [req-0c674834-b055-4779-9e68-16bdc278842b req-c284c0b4-5dc7-4853-b33d-7d7b2e8ce715 tempest-AttachInterfacesUnderV243Test-1887082716 tempest-AttachInterfacesUnderV243Test-1887082716-project-member] Enqueued Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGHEST for action security_group_rules [ 698.939976] env[65322]: INFO networking_nsxv3.common.synchronization [req-0c674834-b055-4779-9e68-16bdc278842b req-c284c0b4-5dc7-4853-b33d-7d7b2e8ce715 tempest-AttachInterfacesUnderV243Test-1887082716 tempest-AttachInterfacesUnderV243Test-1887082716-project-member] Enqueued Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGHEST for action security_group_members [ 698.940120] env[65322]: INFO networking_nsxv3.common.synchronization [req-0c674834-b055-4779-9e68-16bdc278842b req-c284c0b4-5dc7-4853-b33d-7d7b2e8ce715 tempest-AttachInterfacesUnderV243Test-1887082716 tempest-AttachInterfacesUnderV243Test-1887082716-project-member] Enqueued Resource ID: b09507a4-1ab2-4598-9f2c-e147be3587b1 with Priority: HIGHEST for action port [ 698.940768] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGHEST for action security_group_rules [ 698.940900] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGHEST for action security_group_members [ 698.941390] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b09507a4-1ab2-4598-9f2c-e147be3587b1 with Priority: HIGHEST for action port [ 698.941390] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02830029-f973-4892-9d06-f25f8aee730a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.941390] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.942265] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.942265] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.942265] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.942951] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-02830029-f973-4892-9d06-f25f8aee730a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.942951] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.944158] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-b09507a4-1ab2-4598-9f2c-e147be3587b1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.944158] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b09507a4-1ab2-4598-9f2c-e147be3587b1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.944158] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b09507a4-1ab2-4598-9f2c-e147be3587b1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.944158] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b09507a4-1ab2-4598-9f2c-e147be3587b1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.944158] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b09507a4-1ab2-4598-9f2c-e147be3587b1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.988015] env[65322]: INFO networking_nsxv3.common.synchronization [None req-e76ba0f6-20fd-4c46-9198-ce5897fa1369 tempest-ServersTestManualDisk-537044773 tempest-ServersTestManualDisk-537044773-project-member] Enqueued Resource ID: 7f4b8024-2bac-4f34-a6d3-9d32d83408c9 with Priority: HIGHEST for action security_group_rules [ 698.989612] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f4b8024-2bac-4f34-a6d3-9d32d83408c9 with Priority: HIGHEST for action security_group_rules [ 698.990387] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f4b8024-2bac-4f34-a6d3-9d32d83408c9 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.990618] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.990847] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.991219] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.991354] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f4b8024-2bac-4f34-a6d3-9d32d83408c9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.313286] env[65322]: INFO networking_nsxv3.common.synchronization [None req-b67ccea0-3738-48c5-83b1-d73135c8030a None None] Enqueued Resource ID: 4913986a-9cd1-4b3d-b53b-d576daf45754 with Priority: HIGHEST for action port [ 699.314044] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4913986a-9cd1-4b3d-b53b-d576daf45754 with Priority: HIGHEST for action port [ 699.314248] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-4913986a-9cd1-4b3d-b53b-d576daf45754 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.315525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4913986a-9cd1-4b3d-b53b-d576daf45754" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.315525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4913986a-9cd1-4b3d-b53b-d576daf45754" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.315525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4913986a-9cd1-4b3d-b53b-d576daf45754" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.315525] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4913986a-9cd1-4b3d-b53b-d576daf45754',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.418143] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.446653] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-02830029-f973-4892-9d06-f25f8aee730a taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.446806] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.454014] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b09507a4-1ab2-4598-9f2c-e147be3587b1 with status ACTIVE [ 699.454014] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.454014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.454014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.454014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.454014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.454014] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.454014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.454014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.454014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.454014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.454426] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.454426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.454426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.454426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.454577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.454577] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b09507a4-1ab2-4598-9f2c-e147be3587b1 is going to be updated. [ 699.480527] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.480676] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.480751] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.481037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.481191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.481374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b09507a4-1ab2-4598-9f2c-e147be3587b1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.514742] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.514742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.514742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.514742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.514742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.514742] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f4b8024-2bac-4f34-a6d3-9d32d83408c9 already deleted. [ 699.514742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.817446] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4913986a-9cd1-4b3d-b53b-d576daf45754 [ 699.817890] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.817890] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.817890] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.818129] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.818219] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.818316] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4913986a-9cd1-4b3d-b53b-d576daf45754 already deleted. [ 699.818394] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4913986a-9cd1-4b3d-b53b-d576daf45754" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.921577] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.068782] env[65322]: INFO networking_nsxv3.common.synchronization [None req-f2de3064-9966-42ab-8565-cb0ae6053031 tempest-ServersTestManualDisk-537044773 tempest-ServersTestManualDisk-537044773-project-member] Enqueued Resource ID: 7f4b8024-2bac-4f34-a6d3-9d32d83408c9 with Priority: HIGHEST for action security_group_rules [ 700.069312] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f4b8024-2bac-4f34-a6d3-9d32d83408c9 with Priority: HIGHEST for action security_group_rules [ 700.069619] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f4b8024-2bac-4f34-a6d3-9d32d83408c9 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.069750] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.070304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.071147] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.071237] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f4b8024-2bac-4f34-a6d3-9d32d83408c9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.094843] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b782aecb-f199-4bcf-9857-f670ec188036 in Status: SUCCESS [ 700.096329] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b782aecb-f199-4bcf-9857-f670ec188036 deletion is rescheduled due to dependency. [ 700.096329] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.316938] env[65322]: INFO networking_nsxv3.common.synchronization [req-af21ab9b-8359-4e6d-8bdd-58f087c8e008 req-185c9843-4a07-4254-931a-728c92c9fc0d tempest-ServerAddressesNegativeTestJSON-1071925539 tempest-ServerAddressesNegativeTestJSON-1071925539-project-member] Enqueued Resource ID: d7c8bab2-b339-4d16-b55e-addae517cd81 with Priority: HIGHEST for action security_group_members [ 700.317555] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7c8bab2-b339-4d16-b55e-addae517cd81 with Priority: HIGHEST for action security_group_members [ 700.317892] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7c8bab2-b339-4d16-b55e-addae517cd81 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.318077] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.318151] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.318411] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.318620] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.318815] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.318815] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.318987] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.319052] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.319115] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7c8bab2-b339-4d16-b55e-addae517cd81',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.428756] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.428756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.428756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.428756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.428756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.428756] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02830029-f973-4892-9d06-f25f8aee730a is going to be updated. [ 700.469204] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.469352] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.469394] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.469577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.469880] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.479466] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02830029-f973-4892-9d06-f25f8aee730a in Status: IN_PROGRESS for 2s [ 700.594839] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.594839] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.594839] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.595063] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.595063] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.595330] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f4b8024-2bac-4f34-a6d3-9d32d83408c9 already deleted. [ 700.595330] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.821298] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.821590] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.821754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.822031] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.822310] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.822367] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.822541] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.822541] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.826040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.826040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.826040] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7c8bab2-b339-4d16-b55e-addae517cd81 already deleted. [ 700.826040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.896771] env[65322]: INFO networking_nsxv3.common.synchronization [None req-2ccbae5a-b110-481b-8669-e07fcf90013b None None] Enqueued Resource ID: eba52878-147e-4b10-802d-d3d5364460fd with Priority: HIGHEST for action port [ 700.897545] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eba52878-147e-4b10-802d-d3d5364460fd with Priority: HIGHEST for action port [ 700.898355] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-eba52878-147e-4b10-802d-d3d5364460fd taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.898355] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eba52878-147e-4b10-802d-d3d5364460fd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.898355] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eba52878-147e-4b10-802d-d3d5364460fd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.898355] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eba52878-147e-4b10-802d-d3d5364460fd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.898678] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eba52878-147e-4b10-802d-d3d5364460fd',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.132514] env[65322]: INFO networking_nsxv3.common.synchronization [None req-37346de9-0829-4c4a-81d6-bd7aa5433a9a None None] Enqueued Resource ID: 389fd453-3f34-4c41-9314-6359394cd407 with Priority: HIGHEST for action port [ 701.133863] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 389fd453-3f34-4c41-9314-6359394cd407 with Priority: HIGHEST for action port [ 701.134257] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-389fd453-3f34-4c41-9314-6359394cd407 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.134385] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-389fd453-3f34-4c41-9314-6359394cd407" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.134451] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-389fd453-3f34-4c41-9314-6359394cd407" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.134717] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-389fd453-3f34-4c41-9314-6359394cd407" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.134793] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('389fd453-3f34-4c41-9314-6359394cd407',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.382360] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-948 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.382555] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-948" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.383472] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-948" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.388028] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-948" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.388028] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.388028] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.388028] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.388028] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.388028] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.388028] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 701.388028] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 701.388028] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 701.388028] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 701.388028] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 701.388028] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 701.388028] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 701.404392] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eba52878-147e-4b10-802d-d3d5364460fd [ 701.404392] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.404392] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.404392] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.404392] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.404392] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.404392] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eba52878-147e-4b10-802d-d3d5364460fd already deleted. [ 701.404392] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eba52878-147e-4b10-802d-d3d5364460fd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.409495] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 701.409685] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 701.409830] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 701.410026] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-948" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.410367] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-2c564923-afdd-4d26-9e28-c43327e6e846 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.410526] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-2c564923-afdd-4d26-9e28-c43327e6e846" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.410636] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-2c564923-afdd-4d26-9e28-c43327e6e846" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.410945] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-2c564923-afdd-4d26-9e28-c43327e6e846" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.411166] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c564923-afdd-4d26-9e28-c43327e6e846',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.636633] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 389fd453-3f34-4c41-9314-6359394cd407 [ 701.637295] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.638143] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.638143] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.638143] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.638143] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.638143] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:389fd453-3f34-4c41-9314-6359394cd407 already deleted. [ 701.638143] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-389fd453-3f34-4c41-9314-6359394cd407" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.914901] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.915416] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.915494] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.915909] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.916151] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.916419] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 2c564923-afdd-4d26-9e28-c43327e6e846 not found, creating... [ 701.916719] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.916983] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.916983] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.917235] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.917368] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.917649] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.917798] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.917940] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.918184] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.918310] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.918442] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 2c564923-afdd-4d26-9e28-c43327e6e846 is going to be created. [ 701.941848] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.942908] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.943444] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.943523] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.943817] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.944303] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-2c564923-afdd-4d26-9e28-c43327e6e846" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.491978] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02830029-f973-4892-9d06-f25f8aee730a in Status: SUCCESS [ 702.492279] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.492704] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.492704] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.492870] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.493032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.493124] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.493312] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.493391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.493494] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.646878] env[65322]: INFO networking_nsxv3.common.synchronization [req-af21ab9b-8359-4e6d-8bdd-58f087c8e008 req-eecc9e68-94a4-45c3-813a-c151e43f269c service nova] Enqueued Resource ID: d7c8bab2-b339-4d16-b55e-addae517cd81 with Priority: HIGHEST for action security_group_rules [ 702.646878] env[65322]: INFO networking_nsxv3.common.synchronization [req-af21ab9b-8359-4e6d-8bdd-58f087c8e008 req-eecc9e68-94a4-45c3-813a-c151e43f269c service nova] Enqueued Resource ID: d7c8bab2-b339-4d16-b55e-addae517cd81 with Priority: HIGHEST for action security_group_members [ 702.646878] env[65322]: INFO networking_nsxv3.common.synchronization [req-af21ab9b-8359-4e6d-8bdd-58f087c8e008 req-eecc9e68-94a4-45c3-813a-c151e43f269c service nova] Enqueued Resource ID: 2c564923-afdd-4d26-9e28-c43327e6e846 with Priority: HIGHEST for action port [ 702.646878] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7c8bab2-b339-4d16-b55e-addae517cd81 with Priority: HIGHEST for action security_group_rules [ 702.646878] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7c8bab2-b339-4d16-b55e-addae517cd81 with Priority: HIGHEST for action security_group_members [ 702.648078] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c564923-afdd-4d26-9e28-c43327e6e846 with Priority: HIGHEST for action port [ 702.649257] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7c8bab2-b339-4d16-b55e-addae517cd81 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.650539] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.650539] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.650539] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.650539] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7c8bab2-b339-4d16-b55e-addae517cd81',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.652065] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7c8bab2-b339-4d16-b55e-addae517cd81 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.652065] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.652065] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.652065] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.652065] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.652065] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.652065] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.652065] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.652065] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.652065] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7c8bab2-b339-4d16-b55e-addae517cd81',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.655063] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c564923-afdd-4d26-9e28-c43327e6e846 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.655203] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c564923-afdd-4d26-9e28-c43327e6e846" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.655272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c564923-afdd-4d26-9e28-c43327e6e846" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.655456] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c564923-afdd-4d26-9e28-c43327e6e846" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.655562] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c564923-afdd-4d26-9e28-c43327e6e846',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.996813] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.017890] env[65322]: INFO networking_nsxv3.common.synchronization [req-4fac76eb-e805-428b-b40f-4b7234a38e36 req-ed840fbb-6b5e-4b75-b28b-acc66d7b9a2a tempest-ImagesTestJSON-2080608290 tempest-ImagesTestJSON-2080608290-project-member] Enqueued Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 703.018630] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 703.019206] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.019358] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.019429] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.019670] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.020033] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.020033] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.020033] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.020218] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.020303] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.020402] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.154643] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d7c8bab2-b339-4d16-b55e-addae517cd81',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.157729] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7c8bab2-b339-4d16-b55e-addae517cd81 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.157729] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.157729] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c564923-afdd-4d26-9e28-c43327e6e846 with status ACTIVE [ 703.157932] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.158123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.158123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.159021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.159021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.159021] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.159021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.159021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.159283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.159560] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.159777] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.160707] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.160707] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.160707] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.160707] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.160707] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c564923-afdd-4d26-9e28-c43327e6e846 is going to be updated. [ 703.187409] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.187409] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.187409] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.187409] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.187409] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.187409] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c564923-afdd-4d26-9e28-c43327e6e846" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.499629] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.523241] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.523427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.523427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.523657] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.523774] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.524011] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.524174] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.524224] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.524400] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.524480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.524584] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 is going to be updated. [ 703.554738] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.555804] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.557852] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.557852] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.557852] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.570606] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: IN_PROGRESS for 2s [ 703.658573] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d7c8bab2-b339-4d16-b55e-addae517cd81',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.687567] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-564 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.687756] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-564" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.687870] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-564" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.688157] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-564" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.688402] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.688547] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.688805] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.689056] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.690263] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.690598] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.690884] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 703.692201] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 703.692201] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 703.692201] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.692348] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 703.692454] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 703.713390] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 703.713542] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 703.713674] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 703.713976] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-564" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.714191] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-5950af74-40da-4bde-a8e3-09d79d9707b8 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.714359] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-5950af74-40da-4bde-a8e3-09d79d9707b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.714469] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-5950af74-40da-4bde-a8e3-09d79d9707b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.714801] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-5950af74-40da-4bde-a8e3-09d79d9707b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.715054] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5950af74-40da-4bde-a8e3-09d79d9707b8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.847427] env[65322]: INFO networking_nsxv3.common.synchronization [None req-77dbde64-2b7d-4716-b365-bbabb1d5653a None None] Enqueued Resource ID: 259e5733-3c5a-44e9-8ded-d81f323450bd with Priority: HIGHEST for action port [ 703.848137] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 259e5733-3c5a-44e9-8ded-d81f323450bd with Priority: HIGHEST for action port [ 703.848432] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-259e5733-3c5a-44e9-8ded-d81f323450bd taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.848574] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-259e5733-3c5a-44e9-8ded-d81f323450bd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.848644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-259e5733-3c5a-44e9-8ded-d81f323450bd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.848948] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-259e5733-3c5a-44e9-8ded-d81f323450bd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.849078] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('259e5733-3c5a-44e9-8ded-d81f323450bd',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.938830] env[65322]: INFO networking_nsxv3.common.synchronization [None req-8644b738-56e0-4ac2-8ee8-2333cd442adc None None] Enqueued Resource ID: 33a8b8c1-c2f8-4b1c-ab1d-28e3b29c2e9c with Priority: HIGHEST for action port [ 703.938830] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33a8b8c1-c2f8-4b1c-ab1d-28e3b29c2e9c with Priority: HIGHEST for action port [ 703.938830] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-33a8b8c1-c2f8-4b1c-ab1d-28e3b29c2e9c taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.938830] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33a8b8c1-c2f8-4b1c-ab1d-28e3b29c2e9c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.938830] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33a8b8c1-c2f8-4b1c-ab1d-28e3b29c2e9c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.938830] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33a8b8c1-c2f8-4b1c-ab1d-28e3b29c2e9c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.939123] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33a8b8c1-c2f8-4b1c-ab1d-28e3b29c2e9c',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.006027] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.006981] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.006981] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.007232] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.007773] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.008202] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02830029-f973-4892-9d06-f25f8aee730a is going to be updated. [ 704.039624] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.039624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.039746] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.039859] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.039998] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.050174] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02830029-f973-4892-9d06-f25f8aee730a in Status: IN_PROGRESS for 2s [ 704.161063] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.161246] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.161246] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.161434] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.161523] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.161621] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7c8bab2-b339-4d16-b55e-addae517cd81 is going to be created. [ 704.186457] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.186679] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.186679] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.186842] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.187014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.204057] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7c8bab2-b339-4d16-b55e-addae517cd81 in Status: UNINITIALIZED for 2s [ 704.217840] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.218098] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.218183] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.218459] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.218620] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.218754] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 5950af74-40da-4bde-a8e3-09d79d9707b8 not found, creating... [ 704.219013] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.219166] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.219284] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.219498] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.219626] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.219942] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.220111] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.220222] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.220420] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.220554] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.220676] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 5950af74-40da-4bde-a8e3-09d79d9707b8 is going to be created. [ 704.245179] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.245654] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.245654] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.245990] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.246174] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.246434] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-5950af74-40da-4bde-a8e3-09d79d9707b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.352337] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 259e5733-3c5a-44e9-8ded-d81f323450bd [ 704.352337] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.352570] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.352570] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.352820] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.352928] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.353056] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:259e5733-3c5a-44e9-8ded-d81f323450bd already deleted. [ 704.353168] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-259e5733-3c5a-44e9-8ded-d81f323450bd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.444655] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33a8b8c1-c2f8-4b1c-ab1d-28e3b29c2e9c [ 704.444655] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.444655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.444655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.444655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.444655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.444655] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33a8b8c1-c2f8-4b1c-ab1d-28e3b29c2e9c already deleted. [ 704.444655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33a8b8c1-c2f8-4b1c-ab1d-28e3b29c2e9c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.029705] env[65322]: INFO networking_nsxv3.common.synchronization [req-4fac76eb-e805-428b-b40f-4b7234a38e36 req-fc8525b8-7062-4aee-a866-37f3f294c62e service nova] Enqueued Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_rules [ 705.029705] env[65322]: INFO networking_nsxv3.common.synchronization [req-4fac76eb-e805-428b-b40f-4b7234a38e36 req-fc8525b8-7062-4aee-a866-37f3f294c62e service nova] Enqueued Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 705.030033] env[65322]: INFO networking_nsxv3.common.synchronization [req-4fac76eb-e805-428b-b40f-4b7234a38e36 req-fc8525b8-7062-4aee-a866-37f3f294c62e service nova] Enqueued Resource ID: 5950af74-40da-4bde-a8e3-09d79d9707b8 with Priority: HIGHEST for action port [ 705.030483] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_rules [ 705.030608] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 705.030703] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5950af74-40da-4bde-a8e3-09d79d9707b8 with Priority: HIGHEST for action port [ 705.031072] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.031403] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.031471] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.031673] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.031751] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.033380] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.033482] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.033716] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-5950af74-40da-4bde-a8e3-09d79d9707b8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.033793] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5950af74-40da-4bde-a8e3-09d79d9707b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.034024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5950af74-40da-4bde-a8e3-09d79d9707b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.034068] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5950af74-40da-4bde-a8e3-09d79d9707b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.034610] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5950af74-40da-4bde-a8e3-09d79d9707b8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.227898] env[65322]: INFO networking_nsxv3.common.synchronization [req-146bc263-19fd-4794-b663-d58b2cf82a1f req-585ddc17-ad64-47fe-944f-c180b2647b39 tempest-ServersWithSpecificFlavorTestJSON-940507922 tempest-ServersWithSpecificFlavorTestJSON-940507922-project-member] Enqueued Resource ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 with Priority: HIGHEST for action security_group_members [ 705.230783] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 with Priority: HIGHEST for action security_group_members [ 705.230783] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-260ad733-0f5d-43fb-be04-c8ecbbbcea08 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.230783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.230783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.230783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.230783] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.230783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.230783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.230783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.230783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.230783] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('260ad733-0f5d-43fb-be04-c8ecbbbcea08',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.542732] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.542732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.542732] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5950af74-40da-4bde-a8e3-09d79d9707b8 with status ACTIVE [ 705.542732] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.542732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.542732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.542732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.542732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.542732] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.542732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.542732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.542732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.542732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.542732] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.543968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.543968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.543968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.543968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.543968] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5950af74-40da-4bde-a8e3-09d79d9707b8 is going to be updated. [ 705.570141] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.570297] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.570350] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.570658] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.570894] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.571079] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5950af74-40da-4bde-a8e3-09d79d9707b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.580648] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: SUCCESS [ 705.580826] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 deletion is rescheduled due to dependency. [ 705.580941] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.581118] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.581344] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.581495] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.581657] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.581657] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.581861] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.581950] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.582058] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.732260] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.732432] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.732502] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.732720] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.732829] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.733059] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.733175] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.733304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.733356] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.733437] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.733541] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 is going to be updated. [ 705.766302] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.766833] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.766833] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.766968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.767201] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.783012] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 in Status: IN_PROGRESS for 2s [ 706.062345] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02830029-f973-4892-9d06-f25f8aee730a in Status: SUCCESS [ 706.063085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.063085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.063085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.063085] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.063274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.063274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.063346] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.063421] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.063501] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.063585] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.074552] env[65322]: INFO networking_nsxv3.common.synchronization [req-17404f98-118f-4da4-bc9e-02963c0bf0b7 req-89e65b07-db58-4039-9ced-cfdd90e1b740 tempest-ServerActionsTestOtherA-1162989957 tempest-ServerActionsTestOtherA-1162989957-project-member] Enqueued Resource ID: e4dca03f-65fb-4951-910c-8904302d70fa with Priority: HIGHEST for action security_group_members [ 706.075101] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4dca03f-65fb-4951-910c-8904302d70fa with Priority: HIGHEST for action security_group_members [ 706.075394] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4dca03f-65fb-4951-910c-8904302d70fa taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.075507] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.075568] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.075948] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.076202] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.076301] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.076386] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.076570] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.076697] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.076865] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4dca03f-65fb-4951-910c-8904302d70fa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.084110] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.218686] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7c8bab2-b339-4d16-b55e-addae517cd81 in Status: SUCCESS [ 706.218686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.218686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.218686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.218686] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.218686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.218686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.218686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.218686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.218686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.218686] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d7c8bab2-b339-4d16-b55e-addae517cd81',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.457493] env[65322]: INFO networking_nsxv3.common.synchronization [None req-1f955ac3-603f-4fe7-9f24-0d9545a664e4 None None] Enqueued Resource ID: 4d110dc9-70ef-4f6e-b447-11d040b5240b with Priority: HIGHEST for action port [ 706.457625] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d110dc9-70ef-4f6e-b447-11d040b5240b with Priority: HIGHEST for action port [ 706.457847] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d110dc9-70ef-4f6e-b447-11d040b5240b taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.457983] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d110dc9-70ef-4f6e-b447-11d040b5240b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.459526] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d110dc9-70ef-4f6e-b447-11d040b5240b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.460551] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d110dc9-70ef-4f6e-b447-11d040b5240b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.460551] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d110dc9-70ef-4f6e-b447-11d040b5240b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.556879] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-315 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.557081] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-315" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.557202] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-315" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.557828] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-315" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.558174] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.559474] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.559474] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.559980] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.562102] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.562138] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 706.562254] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 706.562402] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 706.562519] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 706.562648] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 706.562648] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 706.562864] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 706.567324] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.584084] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.584084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.584084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.584084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.584084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.584084] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.584084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.584084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.584084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.584084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.584084] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4dca03f-65fb-4951-910c-8904302d70fa already deleted. [ 706.584084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.584084] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 706.584540] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 706.584770] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 706.585050] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-315" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.585338] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-e617876f-ab95-4389-abe7-8fe895feee32 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.585736] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-e617876f-ab95-4389-abe7-8fe895feee32" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.585736] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-e617876f-ab95-4389-abe7-8fe895feee32" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.585914] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-e617876f-ab95-4389-abe7-8fe895feee32" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.585969] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e617876f-ab95-4389-abe7-8fe895feee32',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.594878] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.722586] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7c8bab2-b339-4d16-b55e-addae517cd81 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.722743] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.725284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.725284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.725284] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.725284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.725284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.725284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.725284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.725284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.725284] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7c8bab2-b339-4d16-b55e-addae517cd81 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.725284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.725284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.725284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.725284] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.725284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.725284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.725284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.725284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.725284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.725892] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d7c8bab2-b339-4d16-b55e-addae517cd81',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.962535] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d110dc9-70ef-4f6e-b447-11d040b5240b [ 706.962845] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.963698] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.963698] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.963698] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.963698] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.963698] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d110dc9-70ef-4f6e-b447-11d040b5240b already deleted. [ 706.963698] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d110dc9-70ef-4f6e-b447-11d040b5240b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.068821] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02830029-f973-4892-9d06-f25f8aee730a: rpc.has_security_group_logging(os_id): False [ 707.093689] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.093854] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.093854] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.094879] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.094879] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.094879] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.094879] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.094879] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.094879] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.095141] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.095141] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02830029-f973-4892-9d06-f25f8aee730a is going to be updated. [ 707.096534] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.096667] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.096796] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.097076] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.097235] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.097391] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port e617876f-ab95-4389-abe7-8fe895feee32 not found, creating... [ 707.097628] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.097855] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.098029] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.098306] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.098514] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.098806] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.099051] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.099214] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.099492] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.099686] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.099894] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: e617876f-ab95-4389-abe7-8fe895feee32 is going to be created. [ 707.101345] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.101486] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.101606] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.101844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.101960] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.102225] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 is going to be updated. [ 707.129618] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.129618] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.129618] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.129618] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.129618] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.129618] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-e617876f-ab95-4389-abe7-8fe895feee32" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.140175] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.140175] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.140175] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.140175] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.140175] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.150781] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: IN_PROGRESS for 2s [ 707.176621] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.176621] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.176621] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.176621] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.176621] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.227913] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d7c8bab2-b339-4d16-b55e-addae517cd81: rpc.has_security_group_logging(os_id): False [ 707.251782] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02830029-f973-4892-9d06-f25f8aee730a in Status: IN_PROGRESS for 2s [ 707.270487] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.271524] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.271710] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.272039] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.272195] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.272544] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.272727] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.272849] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.273545] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.273648] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.273960] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.274099] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.274168] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.274342] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.274436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.274633] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.274731] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.274791] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.274935] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.274999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.275108] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7c8bab2-b339-4d16-b55e-addae517cd81 is going to be created. [ 707.379372] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.379581] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.379625] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.379955] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.380175] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.399887] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7c8bab2-b339-4d16-b55e-addae517cd81 in Status: IN_PROGRESS for 2s [ 707.793048] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 in Status: SUCCESS [ 707.793481] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 deletion is rescheduled due to dependency. [ 707.793481] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.842447] env[65322]: INFO networking_nsxv3.common.synchronization [req-17404f98-118f-4da4-bc9e-02963c0bf0b7 req-5c95102f-55e1-448d-ad63-ab7a76a2257c service nova] Enqueued Resource ID: e4dca03f-65fb-4951-910c-8904302d70fa with Priority: HIGHEST for action security_group_rules [ 707.842447] env[65322]: INFO networking_nsxv3.common.synchronization [req-17404f98-118f-4da4-bc9e-02963c0bf0b7 req-5c95102f-55e1-448d-ad63-ab7a76a2257c service nova] Enqueued Resource ID: e4dca03f-65fb-4951-910c-8904302d70fa with Priority: HIGHEST for action security_group_members [ 707.842644] env[65322]: INFO networking_nsxv3.common.synchronization [req-17404f98-118f-4da4-bc9e-02963c0bf0b7 req-5c95102f-55e1-448d-ad63-ab7a76a2257c service nova] Enqueued Resource ID: e617876f-ab95-4389-abe7-8fe895feee32 with Priority: HIGHEST for action port [ 707.843802] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4dca03f-65fb-4951-910c-8904302d70fa with Priority: HIGHEST for action security_group_rules [ 707.843802] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4dca03f-65fb-4951-910c-8904302d70fa with Priority: HIGHEST for action security_group_members [ 707.843901] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e617876f-ab95-4389-abe7-8fe895feee32 with Priority: HIGHEST for action port [ 707.845730] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4dca03f-65fb-4951-910c-8904302d70fa taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.845730] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.845730] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.845730] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.845730] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4dca03f-65fb-4951-910c-8904302d70fa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.846883] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4dca03f-65fb-4951-910c-8904302d70fa taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.847514] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.847686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.847898] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.848095] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.848227] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.848277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.848881] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.848881] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.848881] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4dca03f-65fb-4951-910c-8904302d70fa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.850120] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-e617876f-ab95-4389-abe7-8fe895feee32 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.850120] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e617876f-ab95-4389-abe7-8fe895feee32" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.850120] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e617876f-ab95-4389-abe7-8fe895feee32" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.850120] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e617876f-ab95-4389-abe7-8fe895feee32" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.850307] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e617876f-ab95-4389-abe7-8fe895feee32',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.356403] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4dca03f-65fb-4951-910c-8904302d70fa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.357602] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4dca03f-65fb-4951-910c-8904302d70fa taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.357602] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.357747] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e617876f-ab95-4389-abe7-8fe895feee32 with status ACTIVE [ 708.357893] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.357993] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.358065] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.358265] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.358348] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.358506] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.358636] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.358670] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.358792] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.358869] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.359054] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.359149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.359207] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.359344] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.359415] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.359495] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e617876f-ab95-4389-abe7-8fe895feee32 is going to be updated. [ 708.368549] env[65322]: INFO networking_nsxv3.common.synchronization [req-d9c3c491-14f0-420e-99e5-a41299af7b2d req-2a3c736b-55ba-4008-b96f-07374e9bf764 tempest-ServerRescueTestJSONUnderV235-515906475 tempest-ServerRescueTestJSONUnderV235-515906475-project-member] Enqueued Resource ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 with Priority: HIGHEST for action security_group_members [ 708.368549] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 with Priority: HIGHEST for action security_group_members [ 708.373860] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bde2ba93-08d3-4359-9ce7-0ff97de68964 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.374050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.374139] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.374419] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.374604] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.374710] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.374771] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.374921] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.375023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.375116] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.397360] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.397543] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.397613] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.397887] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.398056] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.398257] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e617876f-ab95-4389-abe7-8fe895feee32" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.866140] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4dca03f-65fb-4951-910c-8904302d70fa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.877789] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.877971] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.878085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.878346] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.878461] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.879325] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.879325] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.879325] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.879325] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.879325] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.879325] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 already deleted. [ 708.879325] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.904208] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-775 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.904208] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-775" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.904208] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-775" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.904463] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-775" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.904708] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.904868] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.904978] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.908324] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.908478] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.908692] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 708.908796] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 708.909543] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 708.909543] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 708.909543] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 708.909543] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 708.909543] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 708.934508] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 708.934860] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 708.934937] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 708.935149] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-775" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.935459] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-22a92399-aa10-468f-bc15-f70016caec48 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.935623] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-22a92399-aa10-468f-bc15-f70016caec48" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.935742] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-22a92399-aa10-468f-bc15-f70016caec48" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.936112] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-22a92399-aa10-468f-bc15-f70016caec48" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.937211] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22a92399-aa10-468f-bc15-f70016caec48',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.166914] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: SUCCESS [ 709.167366] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.167831] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.168023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.168364] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.168738] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.168738] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.169191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.169191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.169335] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.169895] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.272091] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02830029-f973-4892-9d06-f25f8aee730a in Status: SUCCESS [ 709.272376] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.370631] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.372183] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.372183] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.372918] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.372918] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.372918] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4dca03f-65fb-4951-910c-8904302d70fa is going to be created. [ 709.403441] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.403661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.403773] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.403957] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.404215] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.415765] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4dca03f-65fb-4951-910c-8904302d70fa in Status: UNINITIALIZED for 2s [ 709.419015] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7c8bab2-b339-4d16-b55e-addae517cd81 in Status: SUCCESS [ 709.419377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.435770] env[65322]: INFO networking_nsxv3.common.synchronization [None req-61d3d732-bd1c-4f4a-a33f-9fbe524f3dfd None None] Enqueued Resource ID: f96a6f85-d6c2-40c6-a075-824798a0e98f with Priority: HIGHEST for action port [ 709.437352] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f96a6f85-d6c2-40c6-a075-824798a0e98f with Priority: HIGHEST for action port [ 709.437352] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-f96a6f85-d6c2-40c6-a075-824798a0e98f taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.437352] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f96a6f85-d6c2-40c6-a075-824798a0e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.437352] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f96a6f85-d6c2-40c6-a075-824798a0e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.437352] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f96a6f85-d6c2-40c6-a075-824798a0e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.437352] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f96a6f85-d6c2-40c6-a075-824798a0e98f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.439432] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.439432] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.439432] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.439649] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.439862] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.440566] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 22a92399-aa10-468f-bc15-f70016caec48 not found, creating... [ 709.440566] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.440566] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.440566] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.440835] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.440871] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.441152] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.441290] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.441394] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.441609] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.442353] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.442524] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 22a92399-aa10-468f-bc15-f70016caec48 is going to be created. [ 709.469228] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.469576] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.469799] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.470291] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.470628] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.470974] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-22a92399-aa10-468f-bc15-f70016caec48" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.672512] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.672761] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.672855] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.673258] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.673463] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.673638] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.673706] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.673950] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.674053] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.674203] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.674378] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.674477] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.674541] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.674712] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.674894] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.675041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.675119] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.675255] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.675394] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.675394] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.675506] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.939135] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f96a6f85-d6c2-40c6-a075-824798a0e98f [ 709.939376] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.939555] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.939659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.939888] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.939980] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.940384] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f96a6f85-d6c2-40c6-a075-824798a0e98f already deleted. [ 709.940384] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f96a6f85-d6c2-40c6-a075-824798a0e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.177793] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16: rpc.has_security_group_logging(os_id): False [ 710.197716] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.197913] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.197967] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.198368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.198368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.198483] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.198575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.198634] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.198807] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.198888] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.199117] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.199217] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.199275] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.199440] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.199527] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.199713] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.199839] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.199904] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.200340] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.200340] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.200340] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 is going to be updated. [ 710.286166] env[65322]: INFO networking_nsxv3.common.synchronization [req-d9c3c491-14f0-420e-99e5-a41299af7b2d req-871c4e16-7e21-4ffa-9a48-a51fe578885e service nova] Enqueued Resource ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 with Priority: HIGHEST for action security_group_rules [ 710.286340] env[65322]: INFO networking_nsxv3.common.synchronization [req-d9c3c491-14f0-420e-99e5-a41299af7b2d req-871c4e16-7e21-4ffa-9a48-a51fe578885e service nova] Enqueued Resource ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 with Priority: HIGHEST for action security_group_members [ 710.286485] env[65322]: INFO networking_nsxv3.common.synchronization [req-d9c3c491-14f0-420e-99e5-a41299af7b2d req-871c4e16-7e21-4ffa-9a48-a51fe578885e service nova] Enqueued Resource ID: 22a92399-aa10-468f-bc15-f70016caec48 with Priority: HIGHEST for action port [ 710.288443] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 with Priority: HIGHEST for action security_group_rules [ 710.288597] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 with Priority: HIGHEST for action security_group_members [ 710.288692] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22a92399-aa10-468f-bc15-f70016caec48 with Priority: HIGHEST for action port [ 710.289022] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bde2ba93-08d3-4359-9ce7-0ff97de68964 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.289145] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.289210] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.289469] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.289578] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.292653] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bde2ba93-08d3-4359-9ce7-0ff97de68964 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.292803] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.292871] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.293103] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.293265] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.293364] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.293419] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.293655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.293655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.293829] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.294733] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-22a92399-aa10-468f-bc15-f70016caec48 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.294893] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22a92399-aa10-468f-bc15-f70016caec48" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.294893] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22a92399-aa10-468f-bc15-f70016caec48" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.295210] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22a92399-aa10-468f-bc15-f70016caec48" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.295639] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22a92399-aa10-468f-bc15-f70016caec48',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.301717] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.302040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.302116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.302396] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.303222] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.327899] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: IN_PROGRESS for 2s [ 710.727178] env[65322]: INFO networking_nsxv3.common.synchronization [req-5b728e71-00b6-4c5f-8f12-c6107c9faf12 req-22416c89-4892-4ef9-9243-7d01834efebe tempest-ServerDiskConfigTestJSON-1167155511 tempest-ServerDiskConfigTestJSON-1167155511-project-member] Enqueued Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 710.727933] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 710.728127] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.729050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.729050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.729192] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.729378] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.729493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.729590] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.729797] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.729896] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.730011] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.793532] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bde2ba93-08d3-4359-9ce7-0ff97de68964 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.793705] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.799558] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.800818] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22a92399-aa10-468f-bc15-f70016caec48 with status ACTIVE [ 710.800818] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.800977] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.801020] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.801308] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.801308] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.801483] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.801697] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.801697] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.801934] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.801934] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.802142] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.802142] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.802285] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.802315] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.802456] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.802456] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22a92399-aa10-468f-bc15-f70016caec48 is going to be updated. [ 710.826194] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.826368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.826405] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.826602] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.826741] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.826892] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22a92399-aa10-468f-bc15-f70016caec48" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.238436] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.238436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.238436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.238436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.238436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.238436] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.238436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.238436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.238436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.238436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.238436] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 is going to be updated. [ 711.299797] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.300035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.300154] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.300392] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.300567] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.304625] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.314043] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: IN_PROGRESS for 2s [ 711.426960] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4dca03f-65fb-4951-910c-8904302d70fa in Status: SUCCESS [ 711.428051] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.428051] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.428051] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.428051] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.428051] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.428051] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.428051] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.428391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.428391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.428391] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4dca03f-65fb-4951-910c-8904302d70fa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.582187] env[65322]: INFO networking_nsxv3.common.synchronization [req-4fbc61db-0e0e-42db-939f-25181a1ff907 req-04e69ed2-2c6a-405d-8dc0-cb8a4cedc7f4 tempest-SecurityGroupRulesTestJSON-623930063 tempest-SecurityGroupRulesTestJSON-623930063-project-member] Enqueued Resource ID: c59fa228-8478-41b8-ac25-7aeb7459cb09 with Priority: HIGHEST for action security_group_rules [ 711.582586] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c59fa228-8478-41b8-ac25-7aeb7459cb09 with Priority: HIGHEST for action security_group_rules [ 711.582886] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c59fa228-8478-41b8-ac25-7aeb7459cb09 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.583368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c59fa228-8478-41b8-ac25-7aeb7459cb09" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.583368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c59fa228-8478-41b8-ac25-7aeb7459cb09" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.583368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c59fa228-8478-41b8-ac25-7aeb7459cb09" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.584600] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c59fa228-8478-41b8-ac25-7aeb7459cb09',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.807640] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.808028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.808028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.808028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.808133] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.808226] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 is going to be created. [ 711.839892] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.840804] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.840804] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.840804] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.840970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.856237] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 in Status: UNINITIALIZED for 2s [ 711.937681] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4dca03f-65fb-4951-910c-8904302d70fa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.112242] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.112242] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.112242] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.112369] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.112439] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.112508] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c59fa228-8478-41b8-ac25-7aeb7459cb09 already deleted. [ 712.112584] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c59fa228-8478-41b8-ac25-7aeb7459cb09" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.226906] env[65322]: INFO networking_nsxv3.common.synchronization [None req-45f544e6-d155-49e8-bd8d-edca1e700df5 None None] Enqueued Resource ID: 53125024-88cc-44d6-9692-220b1df0bcd9 with Priority: HIGHEST for action port [ 712.229760] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53125024-88cc-44d6-9692-220b1df0bcd9 with Priority: HIGHEST for action port [ 712.229760] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-53125024-88cc-44d6-9692-220b1df0bcd9 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.229760] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53125024-88cc-44d6-9692-220b1df0bcd9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.229760] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53125024-88cc-44d6-9692-220b1df0bcd9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.232718] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53125024-88cc-44d6-9692-220b1df0bcd9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.232718] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53125024-88cc-44d6-9692-220b1df0bcd9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.344405] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: SUCCESS [ 712.344654] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.440728] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4dca03f-65fb-4951-910c-8904302d70fa: rpc.has_security_group_logging(os_id): False [ 712.459194] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.459194] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.459367] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.460522] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.460522] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.460522] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.460522] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.460522] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.460522] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.460522] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.460522] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4dca03f-65fb-4951-910c-8904302d70fa is going to be created. [ 712.530667] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.530845] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.530913] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.531152] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.531600] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.544121] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4dca03f-65fb-4951-910c-8904302d70fa in Status: IN_PROGRESS for 2s [ 712.621322] env[65322]: INFO networking_nsxv3.common.synchronization [req-aaada94a-2b55-4a28-a57b-0c042c00fee8 req-b560b6a8-0ee6-4a2e-b01d-605aedc484c2 tempest-ServersTestFqdnHostnames-1357520545 tempest-ServersTestFqdnHostnames-1357520545-project-member] Enqueued Resource ID: b43d5c58-0cb4-4f14-b009-7fe58147ee41 with Priority: HIGHEST for action security_group_members [ 712.621893] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b43d5c58-0cb4-4f14-b009-7fe58147ee41 with Priority: HIGHEST for action security_group_members [ 712.622410] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-b43d5c58-0cb4-4f14-b009-7fe58147ee41 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.622525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.622590] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.623496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.623496] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.623496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.623496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.623496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.623496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.623859] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b43d5c58-0cb4-4f14-b009-7fe58147ee41',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.736493] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 53125024-88cc-44d6-9692-220b1df0bcd9 [ 712.737575] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.737575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.737575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.737575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.737575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.737575] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:53125024-88cc-44d6-9692-220b1df0bcd9 already deleted. [ 712.737872] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53125024-88cc-44d6-9692-220b1df0bcd9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.127791] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.127791] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.127791] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.127791] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.127791] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.127791] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.127791] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.127791] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.127791] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.127791] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.127791] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b43d5c58-0cb4-4f14-b009-7fe58147ee41 already deleted. [ 713.127791] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.146146] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-605 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.146146] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-605" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.146146] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-605" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.146146] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-605" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.146146] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.146622] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.146867] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.147197] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.147807] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.148144] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 713.148375] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 713.148610] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 713.148940] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 713.149168] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 713.149357] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 713.149644] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 713.172820] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 713.173064] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 713.173181] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 713.173317] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-605" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.173764] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-ab286a41-91d6-4de2-bc8e-fe8067544ab5 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.173963] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-ab286a41-91d6-4de2-bc8e-fe8067544ab5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.174098] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-ab286a41-91d6-4de2-bc8e-fe8067544ab5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.174498] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-ab286a41-91d6-4de2-bc8e-fe8067544ab5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.174786] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab286a41-91d6-4de2-bc8e-fe8067544ab5',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.325065] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: SUCCESS [ 713.325261] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 deletion is rescheduled due to dependency. [ 713.325411] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.677620] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.677825] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.678415] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.678415] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.678799] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.678799] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port ab286a41-91d6-4de2-bc8e-fe8067544ab5 not found, creating... [ 713.679163] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.679341] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.679485] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.679985] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.679985] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.680407] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.680543] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.680679] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.680948] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.681055] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.681209] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: ab286a41-91d6-4de2-bc8e-fe8067544ab5 is going to be created. [ 713.703119] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.703357] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.703476] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.703754] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.704071] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.704299] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-ab286a41-91d6-4de2-bc8e-fe8067544ab5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.867941] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 in Status: SUCCESS [ 713.868275] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.868567] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.868770] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.868970] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.869119] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.869188] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.869404] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.869496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.869607] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.869686] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.372270] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bde2ba93-08d3-4359-9ce7-0ff97de68964 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.372666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.372666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.372915] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.373145] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.373264] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.373330] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.373551] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.373661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.373754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.373906] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bde2ba93-08d3-4359-9ce7-0ff97de68964 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.373988] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.374068] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.374223] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.374358] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.374531] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.374592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.374707] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.374790] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.374877] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.374989] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.420828] env[65322]: INFO networking_nsxv3.common.synchronization [req-aaada94a-2b55-4a28-a57b-0c042c00fee8 req-979c7479-87c3-4513-8f52-3f9b081f29c0 service nova] Enqueued Resource ID: b43d5c58-0cb4-4f14-b009-7fe58147ee41 with Priority: HIGHEST for action security_group_rules [ 714.420997] env[65322]: INFO networking_nsxv3.common.synchronization [req-aaada94a-2b55-4a28-a57b-0c042c00fee8 req-979c7479-87c3-4513-8f52-3f9b081f29c0 service nova] Enqueued Resource ID: b43d5c58-0cb4-4f14-b009-7fe58147ee41 with Priority: HIGHEST for action security_group_members [ 714.421308] env[65322]: INFO networking_nsxv3.common.synchronization [req-aaada94a-2b55-4a28-a57b-0c042c00fee8 req-979c7479-87c3-4513-8f52-3f9b081f29c0 service nova] Enqueued Resource ID: ab286a41-91d6-4de2-bc8e-fe8067544ab5 with Priority: HIGHEST for action port [ 714.422023] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b43d5c58-0cb4-4f14-b009-7fe58147ee41 with Priority: HIGHEST for action security_group_rules [ 714.422464] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b43d5c58-0cb4-4f14-b009-7fe58147ee41 with Priority: HIGHEST for action security_group_members [ 714.422518] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab286a41-91d6-4de2-bc8e-fe8067544ab5 with Priority: HIGHEST for action port [ 714.422782] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b43d5c58-0cb4-4f14-b009-7fe58147ee41 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.422908] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.422999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.423229] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.423312] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b43d5c58-0cb4-4f14-b009-7fe58147ee41',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.424640] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-b43d5c58-0cb4-4f14-b009-7fe58147ee41 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.424764] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.424817] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.424991] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.425242] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.425242] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.425353] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.425432] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.425514] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.425599] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b43d5c58-0cb4-4f14-b009-7fe58147ee41',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.426634] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab286a41-91d6-4de2-bc8e-fe8067544ab5 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.426744] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab286a41-91d6-4de2-bc8e-fe8067544ab5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.426812] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab286a41-91d6-4de2-bc8e-fe8067544ab5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.426960] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab286a41-91d6-4de2-bc8e-fe8067544ab5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.427052] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab286a41-91d6-4de2-bc8e-fe8067544ab5',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.560830] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4dca03f-65fb-4951-910c-8904302d70fa in Status: SUCCESS [ 714.561333] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.877605] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bde2ba93-08d3-4359-9ce7-0ff97de68964: rpc.has_security_group_logging(os_id): False [ 714.898014] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.899278] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.899367] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.900541] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.900541] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.900692] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.900692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.900776] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.900940] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.901052] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.901274] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.901377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.901436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.901622] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.901659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.901827] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.901973] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.902055] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.902198] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.902263] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.902412] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 is going to be created. [ 714.925561] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-b43d5c58-0cb4-4f14-b009-7fe58147ee41 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.925670] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.931758] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b43d5c58-0cb4-4f14-b009-7fe58147ee41',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.934122] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab286a41-91d6-4de2-bc8e-fe8067544ab5 with status ACTIVE [ 714.934122] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.934122] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.934122] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.936960] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.936960] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.936960] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.936960] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.936960] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.936960] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.936960] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.936960] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.936960] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.936960] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.936960] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.936960] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.936960] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab286a41-91d6-4de2-bc8e-fe8067544ab5 is going to be updated. [ 714.963353] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.963565] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.963674] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.964115] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.964266] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.964433] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab286a41-91d6-4de2-bc8e-fe8067544ab5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.996117] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.996536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.998976] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.998976] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.998976] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.009791] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 in Status: IN_PROGRESS for 2s [ 715.370568] env[65322]: INFO networking_nsxv3.common.synchronization [req-9f40ba4e-eba9-4cfc-928f-1755200dbef1 req-818d59dc-d80b-4e69-a582-de86013c0c19 tempest-TenantUsagesTestJSON-1404122371 tempest-TenantUsagesTestJSON-1404122371-project-member] Enqueued Resource ID: bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 with Priority: HIGHEST for action security_group_members [ 715.370568] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 with Priority: HIGHEST for action security_group_members [ 715.370568] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.370568] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.370892] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.371488] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.372230] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.372474] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.372749] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.372966] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.373148] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.373387] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcde6be3-c7fe-48ef-8d48-e1af8b6219a2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.425747] env[65322]: INFO networking_nsxv3.common.synchronization [None req-42641462-33b7-47b4-8be7-413907225bbd None None] Enqueued Resource ID: b7615a53-e19e-4a55-95d1-d31e3aba7fab with Priority: HIGHEST for action port [ 715.427033] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7615a53-e19e-4a55-95d1-d31e3aba7fab with Priority: HIGHEST for action port [ 715.427033] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7615a53-e19e-4a55-95d1-d31e3aba7fab taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.427253] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7615a53-e19e-4a55-95d1-d31e3aba7fab" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.427253] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7615a53-e19e-4a55-95d1-d31e3aba7fab" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.429070] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7615a53-e19e-4a55-95d1-d31e3aba7fab" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.429070] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7615a53-e19e-4a55-95d1-d31e3aba7fab',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.438098] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b43d5c58-0cb4-4f14-b009-7fe58147ee41',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.831780] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-620 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.832018] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.832819] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.833152] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.833427] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.833795] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.833795] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.833906] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.834052] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.834263] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.834366] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.834465] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.834566] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.834664] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.834761] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.834885] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 715.862893] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 715.863712] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 715.863712] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 715.863712] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.863712] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-96daa866-c151-463d-9acf-e6348557cf01 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.864054] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-96daa866-c151-463d-9acf-e6348557cf01" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.864054] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-96daa866-c151-463d-9acf-e6348557cf01" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.865029] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-96daa866-c151-463d-9acf-e6348557cf01" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.865029] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96daa866-c151-463d-9acf-e6348557cf01',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.878014] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.878014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.878014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.878014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.878014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.878014] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.878014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.878014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.878363] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.878363] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.878363] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 already deleted. [ 715.878554] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.930790] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7615a53-e19e-4a55-95d1-d31e3aba7fab [ 715.931041] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.931175] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.932134] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.932404] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.933290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.933423] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7615a53-e19e-4a55-95d1-d31e3aba7fab already deleted. [ 715.933536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7615a53-e19e-4a55-95d1-d31e3aba7fab" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.940226] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.940359] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.940422] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.940719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.940861] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.940978] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b43d5c58-0cb4-4f14-b009-7fe58147ee41 is going to be created. [ 715.974573] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.974719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.974790] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.975012] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.975175] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.986092] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b43d5c58-0cb4-4f14-b009-7fe58147ee41 in Status: UNINITIALIZED for 2s [ 716.367485] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.367756] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.367883] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.368177] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.368326] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.368472] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 96daa866-c151-463d-9acf-e6348557cf01 not found, creating... [ 716.368722] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.368868] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.368977] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.369221] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.369351] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.369622] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.369770] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.369910] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.371280] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.371482] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.371632] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 96daa866-c151-463d-9acf-e6348557cf01 is going to be created. [ 716.395322] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.395601] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.395601] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.395794] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.396018] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.396280] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-96daa866-c151-463d-9acf-e6348557cf01" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.028485] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 in Status: SUCCESS [ 717.028820] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.262017] env[65322]: INFO networking_nsxv3.common.synchronization [req-9f40ba4e-eba9-4cfc-928f-1755200dbef1 req-f44b1079-6bd0-4b27-b83a-66b8c2cef66b service nova] Enqueued Resource ID: bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 with Priority: HIGHEST for action security_group_rules [ 717.262017] env[65322]: INFO networking_nsxv3.common.synchronization [req-9f40ba4e-eba9-4cfc-928f-1755200dbef1 req-f44b1079-6bd0-4b27-b83a-66b8c2cef66b service nova] Enqueued Resource ID: bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 with Priority: HIGHEST for action security_group_members [ 717.262017] env[65322]: INFO networking_nsxv3.common.synchronization [req-9f40ba4e-eba9-4cfc-928f-1755200dbef1 req-f44b1079-6bd0-4b27-b83a-66b8c2cef66b service nova] Enqueued Resource ID: 96daa866-c151-463d-9acf-e6348557cf01 with Priority: HIGHEST for action port [ 717.262017] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 with Priority: HIGHEST for action security_group_rules [ 717.262017] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 with Priority: HIGHEST for action security_group_members [ 717.262017] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96daa866-c151-463d-9acf-e6348557cf01 with Priority: HIGHEST for action port [ 717.267142] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.267142] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.268046] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.268046] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.268046] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcde6be3-c7fe-48ef-8d48-e1af8b6219a2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.271165] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.271165] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.271165] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.271165] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.271165] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.271165] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.271165] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.271165] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.271165] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.273368] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcde6be3-c7fe-48ef-8d48-e1af8b6219a2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.274081] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-96daa866-c151-463d-9acf-e6348557cf01 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.274218] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96daa866-c151-463d-9acf-e6348557cf01" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.274290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96daa866-c151-463d-9acf-e6348557cf01" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.274901] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96daa866-c151-463d-9acf-e6348557cf01" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.274901] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96daa866-c151-463d-9acf-e6348557cf01',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.776755] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.777096] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.777159] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bcde6be3-c7fe-48ef-8d48-e1af8b6219a2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.778026] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96daa866-c151-463d-9acf-e6348557cf01 with status ACTIVE [ 717.778617] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.778617] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.778617] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.778617] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.778617] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.778956] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.778956] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.778956] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.779251] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.779338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.779511] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.779603] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.779715] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.779802] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.779864] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.779952] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96daa866-c151-463d-9acf-e6348557cf01 is going to be updated. [ 717.808032] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.808032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.808032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.808032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.808032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.808032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96daa866-c151-463d-9acf-e6348557cf01" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.998859] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b43d5c58-0cb4-4f14-b009-7fe58147ee41 in Status: SUCCESS [ 717.999427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.999704] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.000050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.000320] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.000502] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.000552] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.000755] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.000885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.001437] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.001437] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b43d5c58-0cb4-4f14-b009-7fe58147ee41',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.011818] env[65322]: INFO networking_nsxv3.common.synchronization [None req-13018cdf-2fbe-41c9-9fc3-82ed5d5b04c8 None None] Enqueued Resource ID: d117c4d9-4af3-4443-a31f-d9fdd13edc94 with Priority: HIGHEST for action port [ 718.012744] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d117c4d9-4af3-4443-a31f-d9fdd13edc94 with Priority: HIGHEST for action port [ 718.012744] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-d117c4d9-4af3-4443-a31f-d9fdd13edc94 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.012744] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d117c4d9-4af3-4443-a31f-d9fdd13edc94" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.012744] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d117c4d9-4af3-4443-a31f-d9fdd13edc94" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.013049] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d117c4d9-4af3-4443-a31f-d9fdd13edc94" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.013098] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d117c4d9-4af3-4443-a31f-d9fdd13edc94',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.159882] env[65322]: INFO networking_nsxv3.common.synchronization [req-6180aa81-5b1e-4c75-b84d-9114f798d554 req-55b06742-8075-45a9-a337-8d9bdda6cc02 tempest-SecurityGroupRulesTestJSON-623930063 tempest-SecurityGroupRulesTestJSON-623930063-project-member] Enqueued Resource ID: 0657db7d-1abf-4604-923d-2678cba4286d with Priority: HIGHEST for action security_group_rules [ 718.159882] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0657db7d-1abf-4604-923d-2678cba4286d with Priority: HIGHEST for action security_group_rules [ 718.160395] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0657db7d-1abf-4604-923d-2678cba4286d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.160665] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0657db7d-1abf-4604-923d-2678cba4286d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.160829] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0657db7d-1abf-4604-923d-2678cba4286d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.161378] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0657db7d-1abf-4604-923d-2678cba4286d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.162519] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0657db7d-1abf-4604-923d-2678cba4286d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.282967] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bcde6be3-c7fe-48ef-8d48-e1af8b6219a2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.506433] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b43d5c58-0cb4-4f14-b009-7fe58147ee41',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.515941] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d117c4d9-4af3-4443-a31f-d9fdd13edc94 [ 718.516224] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.516360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.516428] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.516629] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.516717] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.516809] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d117c4d9-4af3-4443-a31f-d9fdd13edc94 already deleted. [ 718.516881] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d117c4d9-4af3-4443-a31f-d9fdd13edc94" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.561980] env[65322]: INFO networking_nsxv3.common.synchronization [req-8ac1ac33-e9b5-4ec7-b9ce-d45e7668df39 req-06511ac5-81ab-4f80-9926-0b57472c66b9 tempest-AttachInterfacesUnderV243Test-1887082716 tempest-AttachInterfacesUnderV243Test-1887082716-project-member] Enqueued Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGHEST for action security_group_members [ 718.562874] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGHEST for action security_group_members [ 718.562874] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-02830029-f973-4892-9d06-f25f8aee730a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.563144] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.563234] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.563474] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.563632] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.563731] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.563793] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.563942] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.564217] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.564217] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.575166] env[65322]: INFO networking_nsxv3.common.synchronization [req-8ac1ac33-e9b5-4ec7-b9ce-d45e7668df39 req-06511ac5-81ab-4f80-9926-0b57472c66b9 tempest-AttachInterfacesUnderV243Test-1887082716 tempest-AttachInterfacesUnderV243Test-1887082716-project-member] Enqueued Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGHEST for action security_group_rules [ 718.575346] env[65322]: INFO networking_nsxv3.common.synchronization [req-8ac1ac33-e9b5-4ec7-b9ce-d45e7668df39 req-06511ac5-81ab-4f80-9926-0b57472c66b9 tempest-AttachInterfacesUnderV243Test-1887082716 tempest-AttachInterfacesUnderV243Test-1887082716-project-member] Enqueued Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGHEST for action security_group_members [ 718.575478] env[65322]: INFO networking_nsxv3.common.synchronization [req-8ac1ac33-e9b5-4ec7-b9ce-d45e7668df39 req-06511ac5-81ab-4f80-9926-0b57472c66b9 tempest-AttachInterfacesUnderV243Test-1887082716 tempest-AttachInterfacesUnderV243Test-1887082716-project-member] Enqueued Resource ID: b09507a4-1ab2-4598-9f2c-e147be3587b1 with Priority: HIGHEST for action port [ 718.576238] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGHEST for action security_group_rules [ 718.576398] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGHEST for action security_group_members [ 718.576702] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b09507a4-1ab2-4598-9f2c-e147be3587b1 with Priority: HIGHEST for action port [ 718.577079] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02830029-f973-4892-9d06-f25f8aee730a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.577151] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.577248] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.577400] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.577569] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.578872] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-02830029-f973-4892-9d06-f25f8aee730a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.578987] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.579303] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-b09507a4-1ab2-4598-9f2c-e147be3587b1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.579525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b09507a4-1ab2-4598-9f2c-e147be3587b1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.579568] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b09507a4-1ab2-4598-9f2c-e147be3587b1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.581364] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b09507a4-1ab2-4598-9f2c-e147be3587b1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.581364] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b09507a4-1ab2-4598-9f2c-e147be3587b1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.686559] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.686743] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.686886] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.686982] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.687091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.687186] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0657db7d-1abf-4604-923d-2678cba4286d already deleted. [ 718.687277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0657db7d-1abf-4604-923d-2678cba4286d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.788784] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.789068] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.789068] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.789589] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.790159] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.790643] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 is going to be created. [ 718.821094] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.821881] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.821881] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.822093] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.823425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.834795] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 in Status: UNINITIALIZED for 2s [ 719.010035] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b43d5c58-0cb4-4f14-b009-7fe58147ee41: rpc.has_security_group_logging(os_id): False [ 719.030214] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.030483] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.030483] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.030641] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.030732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.030976] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.031093] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.031156] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.031304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.031374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.031464] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b43d5c58-0cb4-4f14-b009-7fe58147ee41 is going to be created. [ 719.067272] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.084467] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-02830029-f973-4892-9d06-f25f8aee730a taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.084467] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.084467] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b09507a4-1ab2-4598-9f2c-e147be3587b1 with status ACTIVE [ 719.084650] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.084650] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.085394] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.085658] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.085769] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.086018] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.086087] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.086122] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.087521] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.087521] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.087521] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.087521] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.087521] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.087521] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.087521] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.087521] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b09507a4-1ab2-4598-9f2c-e147be3587b1 is going to be updated. [ 719.095771] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.096370] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.096370] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.096370] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.096499] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.109769] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b43d5c58-0cb4-4f14-b009-7fe58147ee41 in Status: IN_PROGRESS for 2s [ 719.116088] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.116284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.116349] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.116579] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.116714] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.116929] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b09507a4-1ab2-4598-9f2c-e147be3587b1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.571379] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.883094] env[65322]: INFO networking_nsxv3.common.synchronization [req-b217889e-4cd2-4706-b81b-82662694814b req-297e816c-6947-4dd4-9dc0-c8e4acffb850 tempest-ServerActionsTestOtherB-30032286 tempest-ServerActionsTestOtherB-30032286-project-member] Enqueued Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_members [ 719.883680] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_members [ 719.884354] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-c552e7e9-dc55-4efc-afb8-91a443d0679a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.884842] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.887633] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.887633] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.887633] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.887633] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.887633] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.887633] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.887633] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.887633] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.075877] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.076059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.076059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.076278] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.076431] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.076505] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02830029-f973-4892-9d06-f25f8aee730a is going to be updated. [ 720.114974] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.115187] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.115291] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.115411] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.115647] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.125804] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02830029-f973-4892-9d06-f25f8aee730a in Status: IN_PROGRESS for 2s [ 720.340996] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-580 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.340996] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-580" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.340996] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-580" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.340996] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-580" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.341744] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.341744] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.341905] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.342347] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.342500] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.342718] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 720.342824] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 720.342927] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 720.343043] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 720.343472] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 720.343472] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 720.343472] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 720.362129] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 720.363517] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 720.363517] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 720.363517] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-580" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.363517] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-5118f651-a6c1-4128-9f6a-f85bee4e8cc5 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.363517] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-5118f651-a6c1-4128-9f6a-f85bee4e8cc5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.363517] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-5118f651-a6c1-4128-9f6a-f85bee4e8cc5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.363517] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-5118f651-a6c1-4128-9f6a-f85bee4e8cc5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.363999] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5118f651-a6c1-4128-9f6a-f85bee4e8cc5',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.391525] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.391525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.391525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.391525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.391820] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.392095] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.392388] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.392388] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.392509] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.392649] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.392849] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c552e7e9-dc55-4efc-afb8-91a443d0679a already deleted. [ 720.392970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.838898] env[65322]: INFO networking_nsxv3.common.synchronization [req-b63dbccb-0f6d-4bec-afae-7558a3fd87b3 req-64fe19a7-4290-4533-9be8-c8cc2a07ab10 tempest-ServerRescueTestJSON-780090650 tempest-ServerRescueTestJSON-780090650-project-member] Enqueued Resource ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e with Priority: HIGHEST for action security_group_members [ 720.839717] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e with Priority: HIGHEST for action security_group_members [ 720.840104] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.840241] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.840303] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.840486] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.840635] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.840726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.840786] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.840924] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.841020] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.841113] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88219fc7-d04d-4a0f-88d0-399f8bd7ef8e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.847431] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 in Status: SUCCESS [ 720.847637] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.848081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.848081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.848173] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.848271] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.848332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.848482] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.848559] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.848641] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.848727] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bcde6be3-c7fe-48ef-8d48-e1af8b6219a2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.865686] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.865887] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.866012] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.866306] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.866437] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.866582] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 5118f651-a6c1-4128-9f6a-f85bee4e8cc5 not found, creating... [ 720.866935] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.867117] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.867228] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.867469] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.867598] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.867907] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.868103] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.868219] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.868416] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.868539] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.868672] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 5118f651-a6c1-4128-9f6a-f85bee4e8cc5 is going to be created. [ 720.894157] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.894157] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.894903] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.894903] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.894961] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.895193] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-5118f651-a6c1-4128-9f6a-f85bee4e8cc5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.122713] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b43d5c58-0cb4-4f14-b009-7fe58147ee41 in Status: SUCCESS [ 721.123142] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.345478] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88219fc7-d04d-4a0f-88d0-399f8bd7ef8e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.351628] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.351833] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.351833] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.352353] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.352353] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.352513] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.352513] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.353384] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.353384] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.353384] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.353384] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.353384] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.353384] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.353384] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.353588] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.354296] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.354296] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.354296] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.354296] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.354296] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.354296] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bcde6be3-c7fe-48ef-8d48-e1af8b6219a2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.637862] env[65322]: INFO networking_nsxv3.common.synchronization [req-b217889e-4cd2-4706-b81b-82662694814b req-f8f5dd47-cde0-4d92-83bf-bd7d51f7ac96 service nova] Enqueued Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_rules [ 721.638155] env[65322]: INFO networking_nsxv3.common.synchronization [req-b217889e-4cd2-4706-b81b-82662694814b req-f8f5dd47-cde0-4d92-83bf-bd7d51f7ac96 service nova] Enqueued Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_members [ 721.638328] env[65322]: INFO networking_nsxv3.common.synchronization [req-b217889e-4cd2-4706-b81b-82662694814b req-f8f5dd47-cde0-4d92-83bf-bd7d51f7ac96 service nova] Enqueued Resource ID: 5118f651-a6c1-4128-9f6a-f85bee4e8cc5 with Priority: HIGHEST for action port [ 721.638987] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_rules [ 721.639263] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_members [ 721.639541] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5118f651-a6c1-4128-9f6a-f85bee4e8cc5 with Priority: HIGHEST for action port [ 721.639934] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c552e7e9-dc55-4efc-afb8-91a443d0679a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.640106] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.640163] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.640502] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.640596] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.648868] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-c552e7e9-dc55-4efc-afb8-91a443d0679a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.648868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.648868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.648868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.648868] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.648868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.648868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.648868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.648868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.648868] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.648868] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-5118f651-a6c1-4128-9f6a-f85bee4e8cc5 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.648868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5118f651-a6c1-4128-9f6a-f85bee4e8cc5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.648868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5118f651-a6c1-4128-9f6a-f85bee4e8cc5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.648868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5118f651-a6c1-4128-9f6a-f85bee4e8cc5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.648868] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5118f651-a6c1-4128-9f6a-f85bee4e8cc5',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.847657] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88219fc7-d04d-4a0f-88d0-399f8bd7ef8e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.856812] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bcde6be3-c7fe-48ef-8d48-e1af8b6219a2: rpc.has_security_group_logging(os_id): False [ 721.881665] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.881822] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.881889] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.882141] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.882252] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.882438] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.882539] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.882605] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.882786] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.882855] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.883071] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.883236] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.883318] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.883926] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.884065] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.884330] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.884460] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.885044] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.885208] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.885333] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.885442] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 is going to be created. [ 721.948449] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.948861] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.948861] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.948925] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.949223] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.965746] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 in Status: IN_PROGRESS for 2s [ 722.136284] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02830029-f973-4892-9d06-f25f8aee730a in Status: SUCCESS [ 722.136470] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.137592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.137592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.137592] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.137592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.137592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.137592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.137925] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.137925] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.147833] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-c552e7e9-dc55-4efc-afb8-91a443d0679a taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.147977] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.148195] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.153013] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5118f651-a6c1-4128-9f6a-f85bee4e8cc5 with status ACTIVE [ 722.153923] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.153923] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.153923] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.154364] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.154364] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.154469] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.154637] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.154704] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.154938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.156301] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.156301] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.156301] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.156301] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.156301] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.156301] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.156301] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5118f651-a6c1-4128-9f6a-f85bee4e8cc5 is going to be updated. [ 722.182355] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.182622] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.182622] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.182953] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.182953] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.183162] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5118f651-a6c1-4128-9f6a-f85bee4e8cc5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.350883] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.351121] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.351263] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.351557] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.351699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.351846] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e is going to be updated. [ 722.389827] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.390112] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.390112] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.390361] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.390515] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.401725] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e in Status: IN_PROGRESS for 2s [ 722.640747] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.657590] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.793252] env[65322]: INFO networking_nsxv3.common.synchronization [req-1fac1eb6-fead-4fe8-ac4b-3ba8e51690f7 req-97a3bbd6-f6dc-4617-89bd-2e69ecfa28c4 tempest-ServerAddressesNegativeTestJSON-1071925539 tempest-ServerAddressesNegativeTestJSON-1071925539-project-member] Enqueued Resource ID: d7c8bab2-b339-4d16-b55e-addae517cd81 with Priority: HIGHEST for action security_group_members [ 722.793708] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7c8bab2-b339-4d16-b55e-addae517cd81 with Priority: HIGHEST for action security_group_members [ 722.794104] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7c8bab2-b339-4d16-b55e-addae517cd81 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.794228] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.794228] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.794404] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.794550] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.794649] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.794714] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.794853] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.794938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.795381] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7c8bab2-b339-4d16-b55e-addae517cd81',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.095637] env[65322]: INFO networking_nsxv3.common.synchronization [req-dc9db1d6-e7ef-4032-bfec-bd1d1ed0c522 req-6258ff99-d9f6-424b-aaca-dc40aa35d3b4 tempest-ServersTestBootFromVolume-325336493 tempest-ServersTestBootFromVolume-325336493-project-member] Enqueued Resource ID: 1d03ae1b-566c-4270-87f0-fce3e636d072 with Priority: HIGHEST for action security_group_members [ 723.096199] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d03ae1b-566c-4270-87f0-fce3e636d072 with Priority: HIGHEST for action security_group_members [ 723.096870] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d03ae1b-566c-4270-87f0-fce3e636d072 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.097012] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.097084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.097396] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.097589] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.097673] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.097731] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.097888] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.097987] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.098096] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d03ae1b-566c-4270-87f0-fce3e636d072',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.143628] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.159985] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.160356] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.160443] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.160703] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.160905] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.161157] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c552e7e9-dc55-4efc-afb8-91a443d0679a is going to be created. [ 723.191323] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.191503] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.191543] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.191731] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.191886] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.204933] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: UNINITIALIZED for 2s [ 723.297823] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.298059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.298167] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.298520] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.298895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.299082] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.299227] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.299333] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.299561] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.299672] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.299789] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7c8bab2-b339-4d16-b55e-addae517cd81 is going to be updated. [ 723.351327] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.351327] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.351327] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.351327] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.351327] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.363199] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7c8bab2-b339-4d16-b55e-addae517cd81 in Status: IN_PROGRESS for 2s [ 723.599410] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-435 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.599609] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-435" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.599702] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-435" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.600054] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-435" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.600347] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.600526] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.600637] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.600862] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.601142] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.601258] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 723.601314] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 723.601433] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 723.601543] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 723.601642] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 723.601733] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 723.601816] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 723.603418] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.603572] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.603664] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.603827] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.603922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.604197] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.604329] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.604415] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.604521] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.604628] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.604715] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d03ae1b-566c-4270-87f0-fce3e636d072 already deleted. [ 723.604715] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.625049] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 723.625049] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 723.625254] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 723.625357] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-435" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.625679] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-f2c8762f-0842-462e-9547-739e02c0b6fb taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.625902] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-f2c8762f-0842-462e-9547-739e02c0b6fb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.625965] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-f2c8762f-0842-462e-9547-739e02c0b6fb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.626278] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-f2c8762f-0842-462e-9547-739e02c0b6fb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.626412] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2c8762f-0842-462e-9547-739e02c0b6fb',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.646387] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.646576] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.646616] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.646819] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.646938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.647033] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02830029-f973-4892-9d06-f25f8aee730a is going to be updated. [ 723.684021] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.684021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.684021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.684021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.684021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.694632] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02830029-f973-4892-9d06-f25f8aee730a in Status: IN_PROGRESS for 2s [ 723.988601] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 in Status: SUCCESS [ 723.988601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.130778] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.131452] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.131452] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.131452] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.131639] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.131670] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port f2c8762f-0842-462e-9547-739e02c0b6fb not found, creating... [ 724.131931] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.132123] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.132241] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.132442] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.132569] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.132833] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.133550] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.133706] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.136043] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.136261] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.136468] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: f2c8762f-0842-462e-9547-739e02c0b6fb is going to be created. [ 724.161038] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.161376] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.161482] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.161737] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.162166] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.162306] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-f2c8762f-0842-462e-9547-739e02c0b6fb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.411433] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e in Status: SUCCESS [ 724.411739] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.921871] env[65322]: INFO networking_nsxv3.common.synchronization [req-dc9db1d6-e7ef-4032-bfec-bd1d1ed0c522 req-c2ae1900-2256-49d8-8061-e4a8d88b74e0 service nova] Enqueued Resource ID: 1d03ae1b-566c-4270-87f0-fce3e636d072 with Priority: HIGHEST for action security_group_rules [ 724.921871] env[65322]: INFO networking_nsxv3.common.synchronization [req-dc9db1d6-e7ef-4032-bfec-bd1d1ed0c522 req-c2ae1900-2256-49d8-8061-e4a8d88b74e0 service nova] Enqueued Resource ID: 1d03ae1b-566c-4270-87f0-fce3e636d072 with Priority: HIGHEST for action security_group_members [ 724.921871] env[65322]: INFO networking_nsxv3.common.synchronization [req-dc9db1d6-e7ef-4032-bfec-bd1d1ed0c522 req-c2ae1900-2256-49d8-8061-e4a8d88b74e0 service nova] Enqueued Resource ID: f2c8762f-0842-462e-9547-739e02c0b6fb with Priority: HIGHEST for action port [ 724.921871] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d03ae1b-566c-4270-87f0-fce3e636d072 with Priority: HIGHEST for action security_group_rules [ 724.921871] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d03ae1b-566c-4270-87f0-fce3e636d072 with Priority: HIGHEST for action security_group_members [ 724.921871] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2c8762f-0842-462e-9547-739e02c0b6fb with Priority: HIGHEST for action port [ 724.921871] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1d03ae1b-566c-4270-87f0-fce3e636d072 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.922929] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.923243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.927059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.927059] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1d03ae1b-566c-4270-87f0-fce3e636d072',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.927059] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d03ae1b-566c-4270-87f0-fce3e636d072 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.927059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.927059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.927059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.927059] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.927059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.927059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.927059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.927059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.927059] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d03ae1b-566c-4270-87f0-fce3e636d072',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.928729] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2c8762f-0842-462e-9547-739e02c0b6fb taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.931413] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2c8762f-0842-462e-9547-739e02c0b6fb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.931494] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2c8762f-0842-462e-9547-739e02c0b6fb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.932035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2c8762f-0842-462e-9547-739e02c0b6fb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.932035] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2c8762f-0842-462e-9547-739e02c0b6fb',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.220072] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: SUCCESS [ 725.220072] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.220556] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.220556] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.220714] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.220954] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.221031] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.221179] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.221268] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.221358] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.221451] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.303190] env[65322]: INFO networking_nsxv3.common.synchronization [req-9238e14b-7271-4577-a053-05906842d6ad req-a92eedd7-7f4c-4100-9d8a-d1a03c0f9b26 tempest-ServerMetadataNegativeTestJSON-965581318 tempest-ServerMetadataNegativeTestJSON-965581318-project-member] Enqueued Resource ID: 694536fa-8e1e-4cf0-9017-118a0337a180 with Priority: HIGHEST for action security_group_members [ 725.303946] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 694536fa-8e1e-4cf0-9017-118a0337a180 with Priority: HIGHEST for action security_group_members [ 725.304366] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-694536fa-8e1e-4cf0-9017-118a0337a180 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.304528] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.304583] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.304782] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.307135] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.307279] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.307379] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.307616] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.307716] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.307831] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('694536fa-8e1e-4cf0-9017-118a0337a180',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.381195] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7c8bab2-b339-4d16-b55e-addae517cd81 in Status: SUCCESS [ 725.381420] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7c8bab2-b339-4d16-b55e-addae517cd81 deletion is rescheduled due to dependency. [ 725.381575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.433553] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d03ae1b-566c-4270-87f0-fce3e636d072 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.433711] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.434047] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1d03ae1b-566c-4270-87f0-fce3e636d072',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.436021] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2c8762f-0842-462e-9547-739e02c0b6fb with status ACTIVE [ 725.436255] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.436494] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.436494] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.438022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.438022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.438022] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.438022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.438022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.438022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.438022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.438022] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.438022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.438022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.438022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.438022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.438022] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2c8762f-0842-462e-9547-739e02c0b6fb is going to be updated. [ 725.466826] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.467023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.467198] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.467313] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.467449] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.467685] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2c8762f-0842-462e-9547-739e02c0b6fb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.708998] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02830029-f973-4892-9d06-f25f8aee730a in Status: SUCCESS [ 725.708998] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.709114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.709342] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.709538] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.711040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.711040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.711040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.711040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.711040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.711040] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.724470] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.811216] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.811216] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.811216] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.811216] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.811216] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.811216] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.811556] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.811556] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.811556] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.811556] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.811726] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 694536fa-8e1e-4cf0-9017-118a0337a180 is going to be updated. [ 725.850994] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.851183] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.851292] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.853567] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.853567] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.866329] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 694536fa-8e1e-4cf0-9017-118a0337a180 in Status: IN_PROGRESS for 2s [ 725.941155] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1d03ae1b-566c-4270-87f0-fce3e636d072',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.122256] env[65322]: INFO networking_nsxv3.common.synchronization [req-24802dc8-71d4-475a-bf80-ec772c7e9593 req-6a6c9f12-4fd9-4cf3-b1ab-fc44acd1171e tempest-SecurityGroupRulesTestJSON-623930063 tempest-SecurityGroupRulesTestJSON-623930063-project-member] Enqueued Resource ID: 7d34e357-38c7-4e3e-a5f8-729350ca466a with Priority: HIGHEST for action security_group_rules [ 726.122801] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d34e357-38c7-4e3e-a5f8-729350ca466a with Priority: HIGHEST for action security_group_rules [ 726.123091] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d34e357-38c7-4e3e-a5f8-729350ca466a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.123215] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d34e357-38c7-4e3e-a5f8-729350ca466a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.123283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d34e357-38c7-4e3e-a5f8-729350ca466a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.123540] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d34e357-38c7-4e3e-a5f8-729350ca466a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.123622] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d34e357-38c7-4e3e-a5f8-729350ca466a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.216318] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.232234] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c552e7e9-dc55-4efc-afb8-91a443d0679a: rpc.has_security_group_logging(os_id): False [ 726.263807] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.264015] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.264183] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.264536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.264621] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.264860] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.264979] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.265288] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.265540] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.265599] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.265695] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c552e7e9-dc55-4efc-afb8-91a443d0679a is going to be created. [ 726.352144] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.352144] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.352144] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.352144] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.352144] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.366792] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: IN_PROGRESS for 2s [ 726.442692] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.442895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.442933] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.443172] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.443273] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.443422] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d03ae1b-566c-4270-87f0-fce3e636d072 is going to be created. [ 726.495604] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.495604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.495604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.496375] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.496375] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.512131] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d03ae1b-566c-4270-87f0-fce3e636d072 in Status: UNINITIALIZED for 2s [ 726.646518] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.646661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.646734] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.646943] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.647046] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.647148] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d34e357-38c7-4e3e-a5f8-729350ca466a already deleted. [ 726.647268] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d34e357-38c7-4e3e-a5f8-729350ca466a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.719980] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02830029-f973-4892-9d06-f25f8aee730a: rpc.has_security_group_logging(os_id): False [ 726.739738] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.740209] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.740945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.741320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.741515] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.741866] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.742137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.742310] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.742635] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.742803] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.743156] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02830029-f973-4892-9d06-f25f8aee730a is going to be updated. [ 726.812399] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.812596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.812976] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.812976] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.813148] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.831092] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02830029-f973-4892-9d06-f25f8aee730a in Status: IN_PROGRESS for 2s [ 727.845038] env[65322]: INFO networking_nsxv3.common.synchronization [req-5455ef63-3200-411d-bca8-4f4ffba7cbae req-1ebb4e83-71d3-476c-b7a0-2442ec425a25 tempest-ServersWithSpecificFlavorTestJSON-940507922 tempest-ServersWithSpecificFlavorTestJSON-940507922-project-member] Enqueued Resource ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 with Priority: HIGHEST for action security_group_members [ 727.845909] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 with Priority: HIGHEST for action security_group_members [ 727.846340] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-260ad733-0f5d-43fb-be04-c8ecbbbcea08 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.846529] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.846623] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.846913] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.847187] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.847344] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.847452] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.847692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.847844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.848284] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('260ad733-0f5d-43fb-be04-c8ecbbbcea08',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.878586] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 694536fa-8e1e-4cf0-9017-118a0337a180 in Status: SUCCESS [ 727.878586] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 694536fa-8e1e-4cf0-9017-118a0337a180 deletion is rescheduled due to dependency. [ 727.878586] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-694536fa-8e1e-4cf0-9017-118a0337a180" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.337918] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-483 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.338194] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-483" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.338266] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-483" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.338645] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-483" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.338863] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.339061] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.340155] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.340155] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.340155] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.340155] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.340155] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.340155] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.340155] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.340493] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.340493] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.340591] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.351783] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.351976] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.352095] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.352428] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.352911] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.352911] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.353281] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.353281] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.354099] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.354099] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.354099] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 is going to be updated. [ 728.370246] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.370515] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 728.370697] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.370984] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-483" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.371446] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-305c2f8c-4fdb-486d-a3af-adf6ba220c00 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.371693] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-305c2f8c-4fdb-486d-a3af-adf6ba220c00" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.372243] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-305c2f8c-4fdb-486d-a3af-adf6ba220c00" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.372330] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-305c2f8c-4fdb-486d-a3af-adf6ba220c00" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.372553] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('305c2f8c-4fdb-486d-a3af-adf6ba220c00',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.394093] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: SUCCESS [ 728.394093] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.406487] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.406487] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.406487] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.406487] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.406487] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.420142] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 in Status: IN_PROGRESS for 2s [ 728.530737] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d03ae1b-566c-4270-87f0-fce3e636d072 in Status: SUCCESS [ 728.530737] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.530737] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.530907] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.531070] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.531187] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.531231] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.531448] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.531543] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.531645] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.531736] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1d03ae1b-566c-4270-87f0-fce3e636d072',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.847636] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02830029-f973-4892-9d06-f25f8aee730a in Status: SUCCESS [ 728.848027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.875639] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.877589] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.877589] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.877589] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.877589] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.877589] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 305c2f8c-4fdb-486d-a3af-adf6ba220c00 not found, creating... [ 728.877905] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.878074] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.878186] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.878495] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.878640] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.879012] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.879171] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.879279] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.879536] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.880271] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.880271] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 305c2f8c-4fdb-486d-a3af-adf6ba220c00 is going to be created. [ 728.903343] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.903343] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.903651] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.903763] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.903985] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.905037] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-305c2f8c-4fdb-486d-a3af-adf6ba220c00" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.036298] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1d03ae1b-566c-4270-87f0-fce3e636d072',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.539512] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1d03ae1b-566c-4270-87f0-fce3e636d072: rpc.has_security_group_logging(os_id): False [ 729.549317] env[65322]: INFO networking_nsxv3.common.synchronization [req-295be9f9-925c-41ae-adaf-6d8b864d5b06 req-463f6e15-024c-4597-944c-1369470d3192 tempest-AttachInterfacesUnderV243Test-1887082716 tempest-AttachInterfacesUnderV243Test-1887082716-project-member] Enqueued Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGHEST for action security_group_members [ 729.550033] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGHEST for action security_group_members [ 729.550423] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-02830029-f973-4892-9d06-f25f8aee730a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.550609] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.550695] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.550917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.551130] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.551274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.551358] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.551525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.551615] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.551714] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.560104] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.560259] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.560311] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.560521] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.560611] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.560845] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.560944] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.561015] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.561175] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.561250] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.561336] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1d03ae1b-566c-4270-87f0-fce3e636d072 is going to be created. [ 729.642754] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.642955] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.642997] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.643298] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.643505] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.650837] env[65322]: INFO networking_nsxv3.common.synchronization [req-5455ef63-3200-411d-bca8-4f4ffba7cbae req-77041afe-e57a-4939-8755-27b70b75c60e service nova] Enqueued Resource ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 with Priority: HIGHEST for action security_group_rules [ 729.650837] env[65322]: INFO networking_nsxv3.common.synchronization [req-5455ef63-3200-411d-bca8-4f4ffba7cbae req-77041afe-e57a-4939-8755-27b70b75c60e service nova] Enqueued Resource ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 with Priority: HIGHEST for action security_group_members [ 729.650837] env[65322]: INFO networking_nsxv3.common.synchronization [req-5455ef63-3200-411d-bca8-4f4ffba7cbae req-77041afe-e57a-4939-8755-27b70b75c60e service nova] Enqueued Resource ID: 305c2f8c-4fdb-486d-a3af-adf6ba220c00 with Priority: HIGHEST for action port [ 729.651482] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 with Priority: HIGHEST for action security_group_rules [ 729.653039] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 with Priority: HIGHEST for action security_group_members [ 729.653039] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 305c2f8c-4fdb-486d-a3af-adf6ba220c00 with Priority: HIGHEST for action port [ 729.653382] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-260ad733-0f5d-43fb-be04-c8ecbbbcea08 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.654259] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.654903] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.655744] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.655744] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('260ad733-0f5d-43fb-be04-c8ecbbbcea08',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.657171] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-260ad733-0f5d-43fb-be04-c8ecbbbcea08 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.657420] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.657649] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-305c2f8c-4fdb-486d-a3af-adf6ba220c00 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.657790] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-305c2f8c-4fdb-486d-a3af-adf6ba220c00" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.657892] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-305c2f8c-4fdb-486d-a3af-adf6ba220c00" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.658086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-305c2f8c-4fdb-486d-a3af-adf6ba220c00" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.658168] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('305c2f8c-4fdb-486d-a3af-adf6ba220c00',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.659622] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d03ae1b-566c-4270-87f0-fce3e636d072 in Status: IN_PROGRESS for 2s [ 729.753503] env[65322]: INFO networking_nsxv3.common.synchronization [None req-449668df-bfb8-4dc1-bf23-c65f582fe208 None None] Enqueued Resource ID: 3f98ad52-5d4c-4b44-af15-730723d49520 with Priority: HIGHEST for action port [ 729.753503] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f98ad52-5d4c-4b44-af15-730723d49520 with Priority: HIGHEST for action port [ 729.754111] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f98ad52-5d4c-4b44-af15-730723d49520 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.754492] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f98ad52-5d4c-4b44-af15-730723d49520" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.754714] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f98ad52-5d4c-4b44-af15-730723d49520" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.755115] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f98ad52-5d4c-4b44-af15-730723d49520" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.755417] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f98ad52-5d4c-4b44-af15-730723d49520',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.055688] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.056096] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.056096] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.056458] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.056585] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.056888] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.057059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.057185] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.057353] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.057458] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.057604] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02830029-f973-4892-9d06-f25f8aee730a is going to be updated. [ 730.090452] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.090532] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.090563] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.090983] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.090983] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.106106] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02830029-f973-4892-9d06-f25f8aee730a in Status: IN_PROGRESS for 2s [ 730.159530] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-260ad733-0f5d-43fb-be04-c8ecbbbcea08 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.159740] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.162483] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 305c2f8c-4fdb-486d-a3af-adf6ba220c00 with status ACTIVE [ 730.162483] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.162616] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.162616] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.162823] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.162915] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.163484] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.163484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.163484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.163484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.163724] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.163724] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.163799] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.163829] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.163960] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.164633] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.164633] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 305c2f8c-4fdb-486d-a3af-adf6ba220c00 is going to be updated. [ 730.196681] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.196924] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.196924] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.197867] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.197867] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.197867] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-305c2f8c-4fdb-486d-a3af-adf6ba220c00" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.259051] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f98ad52-5d4c-4b44-af15-730723d49520 [ 730.259376] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.263033] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.263033] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.263033] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.263033] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.263033] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f98ad52-5d4c-4b44-af15-730723d49520 already deleted. [ 730.263033] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f98ad52-5d4c-4b44-af15-730723d49520" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.431244] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 in Status: SUCCESS [ 730.432811] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 deletion is rescheduled due to dependency. [ 730.432811] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.433329] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.433630] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.433894] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.434068] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.434371] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.434512] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.434640] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.434780] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('260ad733-0f5d-43fb-be04-c8ecbbbcea08',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.939905] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('260ad733-0f5d-43fb-be04-c8ecbbbcea08',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.132620] env[65322]: INFO networking_nsxv3.common.synchronization [req-c5f2a147-87fd-453b-bbc2-1096a14baef0 req-2ff1ba67-7616-4437-a7f4-4ac1a860cfe0 tempest-ServersTestManualDisk-537044773 tempest-ServersTestManualDisk-537044773-project-member] Enqueued Resource ID: 7f4b8024-2bac-4f34-a6d3-9d32d83408c9 with Priority: HIGHEST for action security_group_members [ 731.133513] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f4b8024-2bac-4f34-a6d3-9d32d83408c9 with Priority: HIGHEST for action security_group_members [ 731.133848] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f4b8024-2bac-4f34-a6d3-9d32d83408c9 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.134028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.134117] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.134445] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.134614] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.134748] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.135252] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.135252] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.135252] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.135252] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f4b8024-2bac-4f34-a6d3-9d32d83408c9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.442634] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('260ad733-0f5d-43fb-be04-c8ecbbbcea08',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.637668] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.637914] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.638012] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.638279] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.638368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.638612] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.638755] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.638909] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.638974] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.639061] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.639145] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f4b8024-2bac-4f34-a6d3-9d32d83408c9 already deleted. [ 731.639221] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.668186] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-88 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.669169] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-88" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.669169] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-88" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.669169] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-88" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.669365] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.669464] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.669994] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.669994] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.669994] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.670305] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.670305] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 731.670372] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 731.670468] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 731.670568] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 731.670662] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 731.670912] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 731.754506] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1d03ae1b-566c-4270-87f0-fce3e636d072 in Status: SUCCESS [ 731.754865] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.763594] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 731.764403] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.093 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 731.764556] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 731.764741] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-88" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.765073] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-eaaa45aa-e9ec-446e-bdd4-76a18abe99e5 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.765263] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-eaaa45aa-e9ec-446e-bdd4-76a18abe99e5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.765444] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-eaaa45aa-e9ec-446e-bdd4-76a18abe99e5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.765725] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-eaaa45aa-e9ec-446e-bdd4-76a18abe99e5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.765858] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eaaa45aa-e9ec-446e-bdd4-76a18abe99e5',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.950184] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.950814] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.950917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.951133] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.951241] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.951345] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 is going to be updated. [ 731.984340] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.984587] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.984587] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.984798] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.985020] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.001165] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 in Status: IN_PROGRESS for 2s [ 732.118911] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02830029-f973-4892-9d06-f25f8aee730a in Status: SUCCESS [ 732.119086] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02830029-f973-4892-9d06-f25f8aee730a deletion is rescheduled due to dependency. [ 732.119219] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.269216] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.269820] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.269820] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.269951] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.270036] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.270545] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port eaaa45aa-e9ec-446e-bdd4-76a18abe99e5 not found, creating... [ 732.270687] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.270853] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.271016] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.271302] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.271444] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.271781] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.271999] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.272204] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.272442] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.272586] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.272751] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: eaaa45aa-e9ec-446e-bdd4-76a18abe99e5 is going to be created. [ 732.307659] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.307659] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.307659] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.308585] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.308585] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.308585] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-eaaa45aa-e9ec-446e-bdd4-76a18abe99e5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.600409] env[65322]: INFO networking_nsxv3.common.synchronization [None req-60029809-0298-4fab-b6fa-8977fb22236c None None] Enqueued Resource ID: 1147fb00-cad1-4f02-8502-bc3ae03ba625 with Priority: HIGHEST for action port [ 732.600985] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1147fb00-cad1-4f02-8502-bc3ae03ba625 with Priority: HIGHEST for action port [ 732.601327] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-1147fb00-cad1-4f02-8502-bc3ae03ba625 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.601473] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1147fb00-cad1-4f02-8502-bc3ae03ba625" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.601540] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1147fb00-cad1-4f02-8502-bc3ae03ba625" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.601857] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1147fb00-cad1-4f02-8502-bc3ae03ba625" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.601963] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1147fb00-cad1-4f02-8502-bc3ae03ba625',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.989869] env[65322]: INFO networking_nsxv3.common.synchronization [req-c5f2a147-87fd-453b-bbc2-1096a14baef0 req-b991b0c6-f6aa-41ab-aa9b-ac6504730c40 service nova] Enqueued Resource ID: 7f4b8024-2bac-4f34-a6d3-9d32d83408c9 with Priority: HIGHEST for action security_group_rules [ 732.990100] env[65322]: INFO networking_nsxv3.common.synchronization [req-c5f2a147-87fd-453b-bbc2-1096a14baef0 req-b991b0c6-f6aa-41ab-aa9b-ac6504730c40 service nova] Enqueued Resource ID: 7f4b8024-2bac-4f34-a6d3-9d32d83408c9 with Priority: HIGHEST for action security_group_members [ 732.990252] env[65322]: INFO networking_nsxv3.common.synchronization [req-c5f2a147-87fd-453b-bbc2-1096a14baef0 req-b991b0c6-f6aa-41ab-aa9b-ac6504730c40 service nova] Enqueued Resource ID: eaaa45aa-e9ec-446e-bdd4-76a18abe99e5 with Priority: HIGHEST for action port [ 732.991878] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f4b8024-2bac-4f34-a6d3-9d32d83408c9 with Priority: HIGHEST for action security_group_rules [ 732.991878] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f4b8024-2bac-4f34-a6d3-9d32d83408c9 with Priority: HIGHEST for action security_group_members [ 732.991878] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaaa45aa-e9ec-446e-bdd4-76a18abe99e5 with Priority: HIGHEST for action port [ 732.992081] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7f4b8024-2bac-4f34-a6d3-9d32d83408c9 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.992936] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.993022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.993253] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.993414] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7f4b8024-2bac-4f34-a6d3-9d32d83408c9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.995140] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f4b8024-2bac-4f34-a6d3-9d32d83408c9 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.995343] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.995410] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.995614] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.997042] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.997260] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.997260] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.999238] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.999238] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.999238] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f4b8024-2bac-4f34-a6d3-9d32d83408c9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.999238] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-eaaa45aa-e9ec-446e-bdd4-76a18abe99e5 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.999238] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eaaa45aa-e9ec-446e-bdd4-76a18abe99e5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.999762] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eaaa45aa-e9ec-446e-bdd4-76a18abe99e5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.999762] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eaaa45aa-e9ec-446e-bdd4-76a18abe99e5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.999762] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eaaa45aa-e9ec-446e-bdd4-76a18abe99e5',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.105999] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1147fb00-cad1-4f02-8502-bc3ae03ba625 [ 733.106173] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.106309] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.106396] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.106612] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.107057] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.107057] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1147fb00-cad1-4f02-8502-bc3ae03ba625 already deleted. [ 733.107057] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1147fb00-cad1-4f02-8502-bc3ae03ba625" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.506034] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7f4b8024-2bac-4f34-a6d3-9d32d83408c9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.506034] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f4b8024-2bac-4f34-a6d3-9d32d83408c9 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.506034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.506034] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eaaa45aa-e9ec-446e-bdd4-76a18abe99e5 with status ACTIVE [ 733.506034] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.506658] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.506658] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.506658] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.506658] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.506774] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.508178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.508178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.508178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.508178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.508178] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.508178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.508178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.508178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.508178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.508585] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eaaa45aa-e9ec-446e-bdd4-76a18abe99e5 is going to be updated. [ 733.537041] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.537041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.537041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.539330] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.539330] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.539330] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eaaa45aa-e9ec-446e-bdd4-76a18abe99e5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.007655] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7f4b8024-2bac-4f34-a6d3-9d32d83408c9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.012157] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 in Status: SUCCESS [ 734.012157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.012157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.012157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.012157] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.012157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.012157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.012157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.012157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.012157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.012157] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('260ad733-0f5d-43fb-be04-c8ecbbbcea08',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.510522] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.511596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.511596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.511596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.511596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.511596] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f4b8024-2bac-4f34-a6d3-9d32d83408c9 is going to be created. [ 734.513446] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('260ad733-0f5d-43fb-be04-c8ecbbbcea08',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.542795] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.542795] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.543043] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.543188] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.543409] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.560840] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f4b8024-2bac-4f34-a6d3-9d32d83408c9 in Status: UNINITIALIZED for 2s [ 734.755214] env[65322]: INFO networking_nsxv3.common.synchronization [None req-16b1d886-f07c-4d1e-91bb-7f0c74c45274 None None] Enqueued Resource ID: 59877a33-4d90-4a03-9f55-909d4ffb65aa with Priority: HIGHEST for action port [ 734.757189] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59877a33-4d90-4a03-9f55-909d4ffb65aa with Priority: HIGHEST for action port [ 734.757189] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-59877a33-4d90-4a03-9f55-909d4ffb65aa taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.757189] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59877a33-4d90-4a03-9f55-909d4ffb65aa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.757189] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59877a33-4d90-4a03-9f55-909d4ffb65aa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.757189] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59877a33-4d90-4a03-9f55-909d4ffb65aa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.757189] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59877a33-4d90-4a03-9f55-909d4ffb65aa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.017874] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 260ad733-0f5d-43fb-be04-c8ecbbbcea08: rpc.has_security_group_logging(os_id): False [ 735.040996] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.041759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.041759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.041759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.041759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.041982] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.042079] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.042198] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.042367] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.042458] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.042522] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 is going to be updated. [ 735.118270] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.118499] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.118566] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.118809] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.119058] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.138697] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 in Status: IN_PROGRESS for 2s [ 735.265306] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 59877a33-4d90-4a03-9f55-909d4ffb65aa [ 735.265580] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.265723] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.265787] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.266050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.266159] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.266263] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:59877a33-4d90-4a03-9f55-909d4ffb65aa already deleted. [ 735.266355] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59877a33-4d90-4a03-9f55-909d4ffb65aa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.351240] env[65322]: INFO networking_nsxv3.common.synchronization [req-2fcb79f8-3db7-4bc6-b7d8-8254515c2c36 req-bf1ac65a-7eba-498b-95be-513a2c005e1a tempest-ServersTestMultiNic-1695456669 tempest-ServersTestMultiNic-1695456669-project-member] Enqueued Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 736.351240] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 736.351240] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.351240] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.351240] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.351806] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.351806] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.351806] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.351806] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.352032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.352074] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.352177] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.548348] env[65322]: INFO networking_nsxv3.common.synchronization [req-6a546c83-a9cf-4537-97f9-185a1201cd89 req-a0cafdd6-239f-4776-9ebf-50197ad0b7cd tempest-SecurityGroupRulesTestJSON-623930063 tempest-SecurityGroupRulesTestJSON-623930063-project-member] Enqueued Resource ID: af511c45-2f07-49fa-8198-b582aa5b0282 with Priority: HIGHEST for action security_group_rules [ 736.548796] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af511c45-2f07-49fa-8198-b582aa5b0282 with Priority: HIGHEST for action security_group_rules [ 736.550626] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af511c45-2f07-49fa-8198-b582aa5b0282 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.550787] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af511c45-2f07-49fa-8198-b582aa5b0282" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.550851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af511c45-2f07-49fa-8198-b582aa5b0282" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.551134] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af511c45-2f07-49fa-8198-b582aa5b0282" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.551290] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af511c45-2f07-49fa-8198-b582aa5b0282',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.576892] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f4b8024-2bac-4f34-a6d3-9d32d83408c9 in Status: SUCCESS [ 736.577601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.577601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.577601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.577752] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.577856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.577923] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.578109] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.578189] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.578282] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.578353] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7f4b8024-2bac-4f34-a6d3-9d32d83408c9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.859997] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.860204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.860353] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.861086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.861086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.861086] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.861086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.861086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.861292] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.861292] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.861292] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a07e97d-006e-4334-801f-7251980b19f1 already deleted. [ 736.861377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.914583] env[65322]: INFO networking_nsxv3.common.synchronization [req-2fcb79f8-3db7-4bc6-b7d8-8254515c2c36 req-2d70b501-268c-40fc-b49e-252ed9e0164d tempest-ServersTestMultiNic-1695456669 tempest-ServersTestMultiNic-1695456669-project-member] Enqueued Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 736.915304] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 736.915599] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.915721] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.915811] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.916027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.916192] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.916349] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.916349] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.916494] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.917092] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.917092] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.078272] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.078539] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.078539] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.078693] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.078981] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.079127] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af511c45-2f07-49fa-8198-b582aa5b0282 already deleted. [ 737.079252] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af511c45-2f07-49fa-8198-b582aa5b0282" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.080730] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7f4b8024-2bac-4f34-a6d3-9d32d83408c9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.161040] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 in Status: SUCCESS [ 737.161040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.382188] env[65322]: INFO networking_nsxv3.common.synchronization [req-2fcb79f8-3db7-4bc6-b7d8-8254515c2c36 req-d11cca83-6ad5-432a-a489-55bee0e18c65 tempest-ServersTestMultiNic-1695456669 tempest-ServersTestMultiNic-1695456669-project-member] Enqueued Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 737.383390] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 737.383606] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.384065] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.421824] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.421998] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.422049] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.422406] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.422609] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.422724] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.422828] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.422885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.423397] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.423397] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.423397] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a07e97d-006e-4334-801f-7251980b19f1 already deleted. [ 737.423397] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.423547] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.423736] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.423891] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.423989] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.424056] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.424205] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.424277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.424386] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.583290] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7f4b8024-2bac-4f34-a6d3-9d32d83408c9: rpc.has_security_group_logging(os_id): False [ 737.604281] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.604281] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.604281] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.604281] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.604604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.605132] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.605296] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.605399] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.605639] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.605795] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.607033] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7f4b8024-2bac-4f34-a6d3-9d32d83408c9 is going to be created. [ 737.678296] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.679519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.679519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.679656] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.680140] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.694239] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f4b8024-2bac-4f34-a6d3-9d32d83408c9 in Status: IN_PROGRESS for 2s [ 737.746500] env[65322]: INFO networking_nsxv3.common.synchronization [req-096fda6e-937e-48dc-8f5f-bcc841a01fae req-629489c8-1ba0-47fe-abaa-1b808e9b5d9c tempest-ServerRescueTestJSONUnderV235-515906475 tempest-ServerRescueTestJSONUnderV235-515906475-project-member] Enqueued Resource ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 with Priority: HIGHEST for action security_group_members [ 737.746779] env[65322]: INFO networking_nsxv3.common.synchronization [req-096fda6e-937e-48dc-8f5f-bcc841a01fae req-629489c8-1ba0-47fe-abaa-1b808e9b5d9c tempest-ServerRescueTestJSONUnderV235-515906475 tempest-ServerRescueTestJSONUnderV235-515906475-project-member] Enqueued Resource ID: f10d7fb2-989f-41a7-941d-a5f2c98c1197 with Priority: HIGHEST for action security_group_members [ 737.749230] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 with Priority: HIGHEST for action security_group_members [ 737.749230] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f10d7fb2-989f-41a7-941d-a5f2c98c1197 with Priority: HIGHEST for action security_group_members [ 737.749674] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-830 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.749869] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-830" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.750518] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-830" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.750518] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-830" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.750676] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.751269] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.751269] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.751269] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.751269] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.751476] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.751861] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 737.751861] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 737.751861] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 737.751861] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 737.752092] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 737.752092] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 737.753550] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bde2ba93-08d3-4359-9ce7-0ff97de68964 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.753550] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.753550] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.753774] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.753774] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.753871] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.753970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.754402] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.754861] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.754861] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.755868] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f10d7fb2-989f-41a7-941d-a5f2c98c1197 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.755994] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f10d7fb2-989f-41a7-941d-a5f2c98c1197" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.756174] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f10d7fb2-989f-41a7-941d-a5f2c98c1197" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.756405] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f10d7fb2-989f-41a7-941d-a5f2c98c1197" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.756555] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.756725] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.756725] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.758059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.758059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.758059] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f10d7fb2-989f-41a7-941d-a5f2c98c1197',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.780491] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 737.780491] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 737.780766] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 737.780766] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-830" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.781048] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-2101a08b-b3d1-4a38-a09a-5064ee8d20e8 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.781267] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-2101a08b-b3d1-4a38-a09a-5064ee8d20e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.781398] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-2101a08b-b3d1-4a38-a09a-5064ee8d20e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.782053] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-2101a08b-b3d1-4a38-a09a-5064ee8d20e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.782053] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2101a08b-b3d1-4a38-a09a-5064ee8d20e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.785191] env[65322]: INFO networking_nsxv3.common.synchronization [None req-57daf686-514c-43d6-a8dc-4eeae43858f2 None None] Enqueued Resource ID: a97efdfa-76d5-4e62-88a1-eb69c2a1475b with Priority: HIGHEST for action port [ 737.785610] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a97efdfa-76d5-4e62-88a1-eb69c2a1475b with Priority: HIGHEST for action port [ 737.785919] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-a97efdfa-76d5-4e62-88a1-eb69c2a1475b taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.786102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a97efdfa-76d5-4e62-88a1-eb69c2a1475b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.786180] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a97efdfa-76d5-4e62-88a1-eb69c2a1475b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.786391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a97efdfa-76d5-4e62-88a1-eb69c2a1475b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.786482] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a97efdfa-76d5-4e62-88a1-eb69c2a1475b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.800681] env[65322]: INFO networking_nsxv3.common.synchronization [req-096fda6e-937e-48dc-8f5f-bcc841a01fae req-629489c8-1ba0-47fe-abaa-1b808e9b5d9c tempest-ServerRescueTestJSONUnderV235-515906475 tempest-ServerRescueTestJSONUnderV235-515906475-project-member] Enqueued Resource ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 with Priority: HIGHEST for action security_group_rules [ 737.800850] env[65322]: INFO networking_nsxv3.common.synchronization [req-096fda6e-937e-48dc-8f5f-bcc841a01fae req-629489c8-1ba0-47fe-abaa-1b808e9b5d9c tempest-ServerRescueTestJSONUnderV235-515906475 tempest-ServerRescueTestJSONUnderV235-515906475-project-member] Enqueued Resource ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 with Priority: HIGHEST for action security_group_members [ 737.800980] env[65322]: INFO networking_nsxv3.common.synchronization [req-096fda6e-937e-48dc-8f5f-bcc841a01fae req-629489c8-1ba0-47fe-abaa-1b808e9b5d9c tempest-ServerRescueTestJSONUnderV235-515906475 tempest-ServerRescueTestJSONUnderV235-515906475-project-member] Enqueued Resource ID: f10d7fb2-989f-41a7-941d-a5f2c98c1197 with Priority: HIGHEST for action security_group_rules [ 737.801290] env[65322]: INFO networking_nsxv3.common.synchronization [req-096fda6e-937e-48dc-8f5f-bcc841a01fae req-629489c8-1ba0-47fe-abaa-1b808e9b5d9c tempest-ServerRescueTestJSONUnderV235-515906475 tempest-ServerRescueTestJSONUnderV235-515906475-project-member] Enqueued Resource ID: f10d7fb2-989f-41a7-941d-a5f2c98c1197 with Priority: HIGHEST for action security_group_members [ 737.801439] env[65322]: INFO networking_nsxv3.common.synchronization [req-096fda6e-937e-48dc-8f5f-bcc841a01fae req-629489c8-1ba0-47fe-abaa-1b808e9b5d9c tempest-ServerRescueTestJSONUnderV235-515906475 tempest-ServerRescueTestJSONUnderV235-515906475-project-member] Enqueued Resource ID: 22a92399-aa10-468f-bc15-f70016caec48 with Priority: HIGHEST for action port [ 737.802190] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 with Priority: HIGHEST for action security_group_rules [ 737.802327] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f10d7fb2-989f-41a7-941d-a5f2c98c1197 with Priority: HIGHEST for action security_group_rules [ 737.802427] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22a92399-aa10-468f-bc15-f70016caec48 with Priority: HIGHEST for action port [ 737.802519] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 with Priority: HIGHEST for action security_group_members [ 737.802608] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f10d7fb2-989f-41a7-941d-a5f2c98c1197 with Priority: HIGHEST for action security_group_members [ 737.803419] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bde2ba93-08d3-4359-9ce7-0ff97de68964 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.803481] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.803526] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.803724] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.803803] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.804631] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f10d7fb2-989f-41a7-941d-a5f2c98c1197 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.804747] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f10d7fb2-989f-41a7-941d-a5f2c98c1197" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.804816] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f10d7fb2-989f-41a7-941d-a5f2c98c1197" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.805054] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f10d7fb2-989f-41a7-941d-a5f2c98c1197" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.805114] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f10d7fb2-989f-41a7-941d-a5f2c98c1197',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.805854] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-22a92399-aa10-468f-bc15-f70016caec48 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.805952] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22a92399-aa10-468f-bc15-f70016caec48" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.806129] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22a92399-aa10-468f-bc15-f70016caec48" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.806195] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22a92399-aa10-468f-bc15-f70016caec48" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.806254] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22a92399-aa10-468f-bc15-f70016caec48',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.807233] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bde2ba93-08d3-4359-9ce7-0ff97de68964 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.808402] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.808402] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f10d7fb2-989f-41a7-941d-a5f2c98c1197 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.808402] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f10d7fb2-989f-41a7-941d-a5f2c98c1197" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.926760] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.927050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.927241] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.927526] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.927647] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.927900] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.928057] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.928197] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.928399] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.928467] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.928533] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a07e97d-006e-4334-801f-7251980b19f1 already deleted. [ 737.928649] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.259889] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.260877] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f10d7fb2-989f-41a7-941d-a5f2c98c1197',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.284978] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.285195] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.285362] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.287244] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.287244] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.287244] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 2101a08b-b3d1-4a38-a09a-5064ee8d20e8 not found, creating... [ 738.287244] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.287244] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.287244] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.287244] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.287244] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.287574] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.287630] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.288838] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.288838] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.288838] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.288838] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 2101a08b-b3d1-4a38-a09a-5064ee8d20e8 is going to be created. [ 738.290029] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a97efdfa-76d5-4e62-88a1-eb69c2a1475b [ 738.290029] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.290029] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.290029] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.290387] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.290387] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.290387] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a97efdfa-76d5-4e62-88a1-eb69c2a1475b already deleted. [ 738.290484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a97efdfa-76d5-4e62-88a1-eb69c2a1475b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.309025] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f10d7fb2-989f-41a7-941d-a5f2c98c1197 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.309217] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f10d7fb2-989f-41a7-941d-a5f2c98c1197" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.309450] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bde2ba93-08d3-4359-9ce7-0ff97de68964 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.309533] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.309699] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22a92399-aa10-468f-bc15-f70016caec48 with status ACTIVE [ 738.309876] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.309989] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.310065] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.310384] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.310461] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.310651] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.310763] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.310818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.311030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.311079] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.311243] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.311336] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.311394] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.311532] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.311625] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.311708] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22a92399-aa10-468f-bc15-f70016caec48 is going to be updated. [ 738.313927] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.314643] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.314643] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.314643] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.314643] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.314882] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-2101a08b-b3d1-4a38-a09a-5064ee8d20e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.339830] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.340017] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.340065] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.340417] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.340496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.340611] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22a92399-aa10-468f-bc15-f70016caec48" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.763230] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.764298] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f10d7fb2-989f-41a7-941d-a5f2c98c1197',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.851989] env[65322]: INFO networking_nsxv3.common.synchronization [req-b7f0c8e0-344b-4c26-b925-092e71011b05 req-2b3172db-63ee-4510-9c56-050f85767c99 tempest-ServerActionsV293TestJSON-768711526 tempest-ServerActionsV293TestJSON-768711526-project-member] Enqueued Resource ID: aa7cb676-7b51-4e93-980a-5540e7a7e88b with Priority: HIGHEST for action security_group_members [ 738.852838] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7cb676-7b51-4e93-980a-5540e7a7e88b with Priority: HIGHEST for action security_group_members [ 738.853312] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7cb676-7b51-4e93-980a-5540e7a7e88b taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.853472] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.853548] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.853989] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.854240] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.854240] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.854353] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.854441] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.854535] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.854694] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa7cb676-7b51-4e93-980a-5540e7a7e88b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.132026] env[65322]: INFO networking_nsxv3.common.synchronization [req-2fcb79f8-3db7-4bc6-b7d8-8254515c2c36 req-50308323-2724-42f9-ad5a-6123b8ea2fd5 service nova] Enqueued Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_rules [ 739.132026] env[65322]: INFO networking_nsxv3.common.synchronization [req-2fcb79f8-3db7-4bc6-b7d8-8254515c2c36 req-50308323-2724-42f9-ad5a-6123b8ea2fd5 service nova] Enqueued Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 739.132026] env[65322]: INFO networking_nsxv3.common.synchronization [req-2fcb79f8-3db7-4bc6-b7d8-8254515c2c36 req-50308323-2724-42f9-ad5a-6123b8ea2fd5 service nova] Enqueued Resource ID: 2101a08b-b3d1-4a38-a09a-5064ee8d20e8 with Priority: HIGHEST for action port [ 739.132026] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_rules [ 739.132026] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 739.132026] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2101a08b-b3d1-4a38-a09a-5064ee8d20e8 with Priority: HIGHEST for action port [ 739.133622] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.138097] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.138097] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.138097] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.138097] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.138097] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.138097] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.143294] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.143713] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.144035] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.144295] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.144516] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.144805] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.147041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.147041] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.147041] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-2101a08b-b3d1-4a38-a09a-5064ee8d20e8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.147041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2101a08b-b3d1-4a38-a09a-5064ee8d20e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.147041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2101a08b-b3d1-4a38-a09a-5064ee8d20e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.147041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2101a08b-b3d1-4a38-a09a-5064ee8d20e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.147041] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2101a08b-b3d1-4a38-a09a-5064ee8d20e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.267088] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.267289] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.267422] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.267834] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.267911] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.268136] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 is going to be updated. [ 739.270319] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.270523] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.270633] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.270933] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.271069] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.271246] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f10d7fb2-989f-41a7-941d-a5f2c98c1197 is going to be created. [ 739.330705] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.330705] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.331098] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.331098] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.331873] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.339212] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.339722] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.339873] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.340613] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.340914] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.360823] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.360823] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.360823] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.360823] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.360823] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.364813] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.364813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.364813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.364813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.364813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.364813] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa7cb676-7b51-4e93-980a-5540e7a7e88b already deleted. [ 739.364813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.364813] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f10d7fb2-989f-41a7-941d-a5f2c98c1197 in Status: UNINITIALIZED for 2s [ 739.366228] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 in Status: IN_PROGRESS for 2s [ 739.431818] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-530 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.431818] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-530" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.431818] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-530" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.431818] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-530" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.431818] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.431818] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.431818] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.431818] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.431818] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.431818] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.431818] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 739.431818] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 739.431818] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 739.432464] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.432464] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 739.432974] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 739.458076] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 739.458259] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 739.458397] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 739.458563] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-530" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.458875] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-42e12433-031b-43a2-a301-00fef48af81c taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.459049] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-42e12433-031b-43a2-a301-00fef48af81c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.459187] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-42e12433-031b-43a2-a301-00fef48af81c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.459530] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-42e12433-031b-43a2-a301-00fef48af81c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.459664] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42e12433-031b-43a2-a301-00fef48af81c',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.649782] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.650556] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.650556] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.650556] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2101a08b-b3d1-4a38-a09a-5064ee8d20e8 with status ACTIVE [ 739.650828] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.650828] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.650828] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.652028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.652028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.652028] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.652028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.652028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.652028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.652028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.652028] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.652028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.652570] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.652570] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.652570] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.652570] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2101a08b-b3d1-4a38-a09a-5064ee8d20e8 is going to be updated. [ 739.676936] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.677172] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.677172] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.677394] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.677525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.677687] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2101a08b-b3d1-4a38-a09a-5064ee8d20e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.710377] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7f4b8024-2bac-4f34-a6d3-9d32d83408c9 in Status: SUCCESS [ 739.710668] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.789818] env[65322]: INFO networking_nsxv3.common.synchronization [req-c7916113-e886-419c-9c14-7bf98e568512 req-f611732c-fd1a-4558-9c0a-c9371100deec tempest-TenantUsagesTestJSON-1404122371 tempest-TenantUsagesTestJSON-1404122371-project-member] Enqueued Resource ID: bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 with Priority: HIGHEST for action security_group_members [ 739.791034] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 with Priority: HIGHEST for action security_group_members [ 739.791034] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.791034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.791321] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.791394] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.791556] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.791655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.791718] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.791902] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.791993] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.792112] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bcde6be3-c7fe-48ef-8d48-e1af8b6219a2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.963850] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.964145] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.964239] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.964752] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.964752] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.964913] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 42e12433-031b-43a2-a301-00fef48af81c not found, creating... [ 739.965082] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.965243] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.965350] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.965572] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.965707] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.965992] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.966183] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.966272] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.967092] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.967092] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.967092] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 42e12433-031b-43a2-a301-00fef48af81c is going to be created. [ 740.000226] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.000440] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.000596] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.000876] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.001148] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.001468] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-42e12433-031b-43a2-a301-00fef48af81c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.154462] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.170219] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-582 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.170578] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-582" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.170676] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-582" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.170982] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-582" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.171701] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.171888] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.172014] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.172442] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.172764] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.173058] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.173321] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 740.173467] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 740.173607] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 740.173699] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.173805] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 740.173937] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 740.201111] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 740.201291] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 740.201423] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 740.201589] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-582" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.201903] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-d339ff40-a7e6-4296-823d-9046afae6105 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.202080] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-d339ff40-a7e6-4296-823d-9046afae6105" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.202234] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-d339ff40-a7e6-4296-823d-9046afae6105" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.202585] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-d339ff40-a7e6-4296-823d-9046afae6105" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.202786] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d339ff40-a7e6-4296-823d-9046afae6105',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.295282] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.295490] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.295490] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.295717] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.295809] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.296015] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.296120] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.296181] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.296341] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.296414] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.296506] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 is going to be updated. [ 740.327958] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.328177] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.328288] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.328593] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.328793] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.338499] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 in Status: IN_PROGRESS for 2s [ 740.657185] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.657385] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.657385] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.657564] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.657719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.657773] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a07e97d-006e-4334-801f-7251980b19f1 is going to be created. [ 740.691798] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.691952] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.692014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.692936] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.692936] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.705339] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.705339] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.705469] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.705760] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.705904] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.706065] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port d339ff40-a7e6-4296-823d-9046afae6105 not found, creating... [ 740.706355] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.706518] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.706618] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.706845] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.706975] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.707317] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.707469] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.707593] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.708469] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.708469] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.708902] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: d339ff40-a7e6-4296-823d-9046afae6105 is going to be created. [ 740.710567] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: UNINITIALIZED for 2s [ 740.738022] env[65322]: INFO networking_nsxv3.common.synchronization [req-b7f0c8e0-344b-4c26-b925-092e71011b05 req-2d3c8dd4-a4dc-4567-b78f-f56a87d4989d service nova] Enqueued Resource ID: aa7cb676-7b51-4e93-980a-5540e7a7e88b with Priority: HIGHEST for action security_group_rules [ 740.738022] env[65322]: INFO networking_nsxv3.common.synchronization [req-b7f0c8e0-344b-4c26-b925-092e71011b05 req-2d3c8dd4-a4dc-4567-b78f-f56a87d4989d service nova] Enqueued Resource ID: aa7cb676-7b51-4e93-980a-5540e7a7e88b with Priority: HIGHEST for action security_group_members [ 740.738022] env[65322]: INFO networking_nsxv3.common.synchronization [req-b7f0c8e0-344b-4c26-b925-092e71011b05 req-2d3c8dd4-a4dc-4567-b78f-f56a87d4989d service nova] Enqueued Resource ID: 42e12433-031b-43a2-a301-00fef48af81c with Priority: HIGHEST for action port [ 740.738022] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.738022] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.738022] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.738022] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.738022] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.738022] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-d339ff40-a7e6-4296-823d-9046afae6105" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.739589] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7cb676-7b51-4e93-980a-5540e7a7e88b with Priority: HIGHEST for action security_group_rules [ 740.739738] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7cb676-7b51-4e93-980a-5540e7a7e88b with Priority: HIGHEST for action security_group_members [ 740.739843] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42e12433-031b-43a2-a301-00fef48af81c with Priority: HIGHEST for action port [ 740.740515] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa7cb676-7b51-4e93-980a-5540e7a7e88b taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.740645] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.740728] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.741333] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.741333] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa7cb676-7b51-4e93-980a-5540e7a7e88b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.741975] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7cb676-7b51-4e93-980a-5540e7a7e88b taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.742105] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.742848] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.742848] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.742848] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.742848] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.742848] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.742848] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.743079] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.743079] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa7cb676-7b51-4e93-980a-5540e7a7e88b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.743924] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-42e12433-031b-43a2-a301-00fef48af81c taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.744070] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42e12433-031b-43a2-a301-00fef48af81c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.744116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42e12433-031b-43a2-a301-00fef48af81c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.744310] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42e12433-031b-43a2-a301-00fef48af81c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.744413] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42e12433-031b-43a2-a301-00fef48af81c',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.246792] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7cb676-7b51-4e93-980a-5540e7a7e88b taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.247104] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.247203] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa7cb676-7b51-4e93-980a-5540e7a7e88b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.248100] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42e12433-031b-43a2-a301-00fef48af81c with status ACTIVE [ 741.248630] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.248630] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.248630] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.248857] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.248857] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.248972] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.249093] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.249146] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.251873] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.251873] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.251873] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.251873] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.251873] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.251873] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.251873] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.251873] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42e12433-031b-43a2-a301-00fef48af81c is going to be updated. [ 741.292135] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.292135] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.292135] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.292135] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.292135] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.292135] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42e12433-031b-43a2-a301-00fef48af81c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.387974] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f10d7fb2-989f-41a7-941d-a5f2c98c1197 in Status: SUCCESS [ 741.388280] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f10d7fb2-989f-41a7-941d-a5f2c98c1197" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.388462] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f10d7fb2-989f-41a7-941d-a5f2c98c1197" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.388687] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f10d7fb2-989f-41a7-941d-a5f2c98c1197" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.388872] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.388989] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.389075] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.389212] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.389293] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.389427] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f10d7fb2-989f-41a7-941d-a5f2c98c1197',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.390851] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 in Status: SUCCESS [ 741.391026] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.391173] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.391458] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.391576] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.391680] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.391741] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.391881] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.391959] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.392050] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.486623] env[65322]: INFO networking_nsxv3.common.synchronization [req-2fcb79f8-3db7-4bc6-b7d8-8254515c2c36 req-6ef44c7d-edc3-4c0a-8586-3c2b6c4603e4 service nova] Enqueued Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_rules [ 741.486833] env[65322]: INFO networking_nsxv3.common.synchronization [req-2fcb79f8-3db7-4bc6-b7d8-8254515c2c36 req-6ef44c7d-edc3-4c0a-8586-3c2b6c4603e4 service nova] Enqueued Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 741.486961] env[65322]: INFO networking_nsxv3.common.synchronization [req-2fcb79f8-3db7-4bc6-b7d8-8254515c2c36 req-6ef44c7d-edc3-4c0a-8586-3c2b6c4603e4 service nova] Enqueued Resource ID: d339ff40-a7e6-4296-823d-9046afae6105 with Priority: HIGHEST for action port [ 741.487511] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_rules [ 741.487671] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 741.487771] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d339ff40-a7e6-4296-823d-9046afae6105 with Priority: HIGHEST for action port [ 741.488051] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.488158] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.488361] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.488458] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.488608] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-d339ff40-a7e6-4296-823d-9046afae6105 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.488706] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d339ff40-a7e6-4296-823d-9046afae6105" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.488762] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d339ff40-a7e6-4296-823d-9046afae6105" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.488961] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d339ff40-a7e6-4296-823d-9046afae6105" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.489049] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d339ff40-a7e6-4296-823d-9046afae6105',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.613999] env[65322]: INFO networking_nsxv3.common.synchronization [req-f140ba7f-8b1e-49c6-97ae-343a1a53bc17 req-78992806-e9bc-4f30-a5e3-d3e7ca2c5e8e tempest-ServerDiskConfigTestJSON-1167155511 tempest-ServerDiskConfigTestJSON-1167155511-project-member] Enqueued Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 741.613999] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 741.613999] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.613999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.613999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.613999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.613999] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.613999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.613999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.613999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.613999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.613999] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.754851] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa7cb676-7b51-4e93-980a-5540e7a7e88b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.864615] env[65322]: INFO networking_nsxv3.common.synchronization [req-fd50be68-a799-492c-9549-7f070fd2babc req-7a0ff75a-dde9-486c-8026-da1a0c8f939d tempest-ServerRescueTestJSONUnderV235-515906475 tempest-ServerRescueTestJSONUnderV235-515906475-project-member] Enqueued Resource ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 with Priority: HIGHEST for action security_group_members [ 741.864615] env[65322]: INFO networking_nsxv3.common.synchronization [req-fd50be68-a799-492c-9549-7f070fd2babc req-7a0ff75a-dde9-486c-8026-da1a0c8f939d tempest-ServerRescueTestJSONUnderV235-515906475 tempest-ServerRescueTestJSONUnderV235-515906475-project-member] Enqueued Resource ID: f10d7fb2-989f-41a7-941d-a5f2c98c1197 with Priority: HIGHEST for action security_group_members [ 741.864994] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 with Priority: HIGHEST for action security_group_members [ 741.864994] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f10d7fb2-989f-41a7-941d-a5f2c98c1197 with Priority: HIGHEST for action security_group_members [ 741.865359] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bde2ba93-08d3-4359-9ce7-0ff97de68964 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.865500] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.865649] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f10d7fb2-989f-41a7-941d-a5f2c98c1197 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.865850] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f10d7fb2-989f-41a7-941d-a5f2c98c1197" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.894206] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f10d7fb2-989f-41a7-941d-a5f2c98c1197',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.895381] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.908936] env[65322]: INFO networking_nsxv3.common.synchronization [req-fd50be68-a799-492c-9549-7f070fd2babc req-7a0ff75a-dde9-486c-8026-da1a0c8f939d tempest-ServerRescueTestJSONUnderV235-515906475 tempest-ServerRescueTestJSONUnderV235-515906475-project-member] Enqueued Resource ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 with Priority: HIGHEST for action security_group_rules [ 741.909941] env[65322]: INFO networking_nsxv3.common.synchronization [req-fd50be68-a799-492c-9549-7f070fd2babc req-7a0ff75a-dde9-486c-8026-da1a0c8f939d tempest-ServerRescueTestJSONUnderV235-515906475 tempest-ServerRescueTestJSONUnderV235-515906475-project-member] Enqueued Resource ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 with Priority: HIGHEST for action security_group_members [ 741.909941] env[65322]: INFO networking_nsxv3.common.synchronization [req-fd50be68-a799-492c-9549-7f070fd2babc req-7a0ff75a-dde9-486c-8026-da1a0c8f939d tempest-ServerRescueTestJSONUnderV235-515906475 tempest-ServerRescueTestJSONUnderV235-515906475-project-member] Enqueued Resource ID: 22a92399-aa10-468f-bc15-f70016caec48 with Priority: HIGHEST for action port [ 741.910520] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 with Priority: HIGHEST for action security_group_rules [ 741.910661] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 with Priority: HIGHEST for action security_group_members [ 741.910756] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22a92399-aa10-468f-bc15-f70016caec48 with Priority: HIGHEST for action port [ 741.911484] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bde2ba93-08d3-4359-9ce7-0ff97de68964 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.911599] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.911846] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bde2ba93-08d3-4359-9ce7-0ff97de68964 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.911914] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.912134] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-22a92399-aa10-468f-bc15-f70016caec48 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.912321] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22a92399-aa10-468f-bc15-f70016caec48" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.912475] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22a92399-aa10-468f-bc15-f70016caec48" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.912632] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22a92399-aa10-468f-bc15-f70016caec48" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.912685] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22a92399-aa10-468f-bc15-f70016caec48',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.991775] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d339ff40-a7e6-4296-823d-9046afae6105 with status ACTIVE [ 741.992017] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.992235] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.992315] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.992542] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.992631] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.992810] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.992908] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.992969] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.993159] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.993249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.993486] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.993588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.993709] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.993789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.993863] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.993956] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d339ff40-a7e6-4296-823d-9046afae6105 is going to be updated. [ 741.997793] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-173 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.997993] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-173" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.998076] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-173" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.998301] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-173" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.999067] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.999067] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.999067] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.999067] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.999246] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.999278] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 741.999382] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 741.999479] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.000622] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.000622] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 742.000622] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.000622] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 742.023492] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.023698] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.023825] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.024094] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.024303] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.025074] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d339ff40-a7e6-4296-823d-9046afae6105" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.026664] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 742.026664] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 742.026664] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 742.026664] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-173" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.026664] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-198acc8b-6c89-449b-b2cb-b699c075b189 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.026938] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-198acc8b-6c89-449b-b2cb-b699c075b189" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.026938] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-198acc8b-6c89-449b-b2cb-b699c075b189" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.027321] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-198acc8b-6c89-449b-b2cb-b699c075b189" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.027500] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('198acc8b-6c89-449b-b2cb-b699c075b189',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.117648] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.117808] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.117892] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.118131] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.118238] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.118440] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.118548] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.118611] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.118759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.118843] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.118930] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 is going to be updated. [ 742.149623] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.149799] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.149893] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.150193] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.150425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.165539] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: IN_PROGRESS for 2s [ 742.261772] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.261772] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.261772] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.261772] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.261772] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.261772] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa7cb676-7b51-4e93-980a-5540e7a7e88b is going to be created. [ 742.303936] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.304174] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.304174] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.304388] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.304637] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.316409] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7cb676-7b51-4e93-980a-5540e7a7e88b in Status: UNINITIALIZED for 2s [ 742.350185] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 in Status: SUCCESS [ 742.350185] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 deletion is rescheduled due to dependency. [ 742.350185] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.359266] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-830 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.359402] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-830" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.359651] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-830" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.359759] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-830" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.359999] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.360158] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.360321] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.360461] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.360592] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.360914] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 742.361900] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 742.364039] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.364039] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.364039] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 742.364039] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.364039] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 742.387708] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 742.387948] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 742.388292] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 742.388547] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-830" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.389013] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-f482fc6d-8858-4ad6-b107-87e59db29a49 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.389345] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-f482fc6d-8858-4ad6-b107-87e59db29a49" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.389580] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-f482fc6d-8858-4ad6-b107-87e59db29a49" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.390011] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-f482fc6d-8858-4ad6-b107-87e59db29a49" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.390241] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f482fc6d-8858-4ad6-b107-87e59db29a49',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.398340] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f10d7fb2-989f-41a7-941d-a5f2c98c1197',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.399529] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.415163] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22a92399-aa10-468f-bc15-f70016caec48 with status ACTIVE [ 742.415372] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.415508] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.415577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.415784] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.415918] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.416116] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.416220] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.416277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.416437] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.416561] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.416759] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.416855] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.416923] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.417158] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.417243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.417333] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22a92399-aa10-468f-bc15-f70016caec48 is going to be updated. [ 742.441527] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.441842] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.441842] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.442030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.442125] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.442339] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22a92399-aa10-468f-bc15-f70016caec48" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.530811] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.531099] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.531232] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.531577] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.531816] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.532076] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 198acc8b-6c89-449b-b2cb-b699c075b189 not found, creating... [ 742.532307] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.532575] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.532761] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.533059] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.533197] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.533461] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.533667] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.533848] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.534218] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.534382] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.534521] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 198acc8b-6c89-449b-b2cb-b699c075b189 is going to be created. [ 742.570300] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.570599] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.570764] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.571199] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.571536] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.571859] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-198acc8b-6c89-449b-b2cb-b699c075b189" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.720964] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: SUCCESS [ 742.721221] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.721438] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.721779] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.721988] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.722142] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.722280] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.722480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.722588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.722694] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.723070] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.724024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.724024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.724146] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.724201] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.724279] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.724435] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.724577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.724667] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.894106] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.894413] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.894510] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.894807] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.895017] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.895177] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port f482fc6d-8858-4ad6-b107-87e59db29a49 not found, creating... [ 742.895453] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.895635] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.895750] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.895988] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.896157] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.896447] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.896598] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.896706] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.896925] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.897064] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.897218] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: f482fc6d-8858-4ad6-b107-87e59db29a49 is going to be created. [ 742.901217] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.901351] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.901406] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.901637] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.901727] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.901845] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f10d7fb2-989f-41a7-941d-a5f2c98c1197 is going to be updated. [ 742.903296] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.903431] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.903557] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.903745] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.903828] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.903915] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 is going to be updated. [ 742.924151] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.924389] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.924551] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.924862] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.925096] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.925335] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-f482fc6d-8858-4ad6-b107-87e59db29a49" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.930974] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.931182] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.931327] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.931575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.931746] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.933578] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.933683] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.933833] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.933933] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.934070] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.944256] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 in Status: IN_PROGRESS for 2s [ 742.945016] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f10d7fb2-989f-41a7-941d-a5f2c98c1197 in Status: IN_PROGRESS for 2s [ 743.229340] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.229601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.229653] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.279722] env[65322]: INFO networking_nsxv3.common.synchronization [req-f140ba7f-8b1e-49c6-97ae-343a1a53bc17 req-1b40ea3d-96ce-4160-be94-617a3b4ed024 service nova] Enqueued Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_rules [ 743.280207] env[65322]: INFO networking_nsxv3.common.synchronization [req-f140ba7f-8b1e-49c6-97ae-343a1a53bc17 req-1b40ea3d-96ce-4160-be94-617a3b4ed024 service nova] Enqueued Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 743.280566] env[65322]: INFO networking_nsxv3.common.synchronization [req-f140ba7f-8b1e-49c6-97ae-343a1a53bc17 req-1b40ea3d-96ce-4160-be94-617a3b4ed024 service nova] Enqueued Resource ID: 198acc8b-6c89-449b-b2cb-b699c075b189 with Priority: HIGHEST for action port [ 743.281415] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_rules [ 743.281640] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 743.281840] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 198acc8b-6c89-449b-b2cb-b699c075b189 with Priority: HIGHEST for action port [ 743.282251] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.282432] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.282512] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.282904] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.282969] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.285140] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.285905] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.286907] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-198acc8b-6c89-449b-b2cb-b699c075b189 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.287159] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-198acc8b-6c89-449b-b2cb-b699c075b189" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.288575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-198acc8b-6c89-449b-b2cb-b699c075b189" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.288575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-198acc8b-6c89-449b-b2cb-b699c075b189" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.288575] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('198acc8b-6c89-449b-b2cb-b699c075b189',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.654703] env[65322]: INFO networking_nsxv3.common.synchronization [req-2fcb79f8-3db7-4bc6-b7d8-8254515c2c36 req-4d5722e4-2a89-4e4f-8a9c-dd7e7d668782 service nova] Enqueued Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_rules [ 743.654884] env[65322]: INFO networking_nsxv3.common.synchronization [req-2fcb79f8-3db7-4bc6-b7d8-8254515c2c36 req-4d5722e4-2a89-4e4f-8a9c-dd7e7d668782 service nova] Enqueued Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 743.655032] env[65322]: INFO networking_nsxv3.common.synchronization [req-2fcb79f8-3db7-4bc6-b7d8-8254515c2c36 req-4d5722e4-2a89-4e4f-8a9c-dd7e7d668782 service nova] Enqueued Resource ID: f482fc6d-8858-4ad6-b107-87e59db29a49 with Priority: HIGHEST for action port [ 743.655639] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_rules [ 743.655773] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 743.655874] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f482fc6d-8858-4ad6-b107-87e59db29a49 with Priority: HIGHEST for action port [ 743.656817] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.656817] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.656817] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.656977] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.657020] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-f482fc6d-8858-4ad6-b107-87e59db29a49 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.657131] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f482fc6d-8858-4ad6-b107-87e59db29a49" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.657274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f482fc6d-8858-4ad6-b107-87e59db29a49" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.657493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f482fc6d-8858-4ad6-b107-87e59db29a49" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.657608] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f482fc6d-8858-4ad6-b107-87e59db29a49',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.731854] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.786205] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.789019] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.791767] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 198acc8b-6c89-449b-b2cb-b699c075b189 with status ACTIVE [ 743.792021] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.792158] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.792247] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.792504] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.792802] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.792802] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.792938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.792993] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.794044] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.794044] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.794044] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.794044] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.794044] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.794044] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.794044] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.794547] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 198acc8b-6c89-449b-b2cb-b699c075b189 is going to be updated. [ 743.818884] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.819096] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.819180] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.819338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.820798] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.820798] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-198acc8b-6c89-449b-b2cb-b699c075b189" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.160864] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f482fc6d-8858-4ad6-b107-87e59db29a49 with status ACTIVE [ 744.160970] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.161478] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.161478] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.161679] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.161795] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.162060] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.162214] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.162292] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.162509] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.162641] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.162930] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.163063] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.163130] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.163280] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.163356] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.163439] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f482fc6d-8858-4ad6-b107-87e59db29a49 is going to be updated. [ 744.177537] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: SUCCESS [ 744.177537] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 deletion is rescheduled due to dependency. [ 744.177732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.177732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.177932] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.178130] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.178243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.178291] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.179274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.179274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.179274] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.189871] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.190035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.190126] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.190375] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.190511] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.190685] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f482fc6d-8858-4ad6-b107-87e59db29a49" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.236827] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.236827] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.236827] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.236827] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.236827] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.237263] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a07e97d-006e-4334-801f-7251980b19f1 is going to be updated. [ 744.286233] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.286561] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.286561] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.286668] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.286901] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.306908] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: IN_PROGRESS for 2s [ 744.337713] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7cb676-7b51-4e93-980a-5540e7a7e88b in Status: SUCCESS [ 744.337932] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.338148] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.338374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.338570] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.338722] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.338775] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.338920] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.338960] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.339047] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.339156] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa7cb676-7b51-4e93-980a-5540e7a7e88b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.512596] env[65322]: INFO networking_nsxv3.common.synchronization [req-d9806d30-eaf3-4b64-b05f-f045dde0cd9c req-64fe734f-dd77-4fde-9da9-2cdd83d31a86 tempest-ListServerFiltersTestJSON-548115459 tempest-ListServerFiltersTestJSON-548115459-project-member] Enqueued Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGHEST for action security_group_members [ 744.513545] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGHEST for action security_group_members [ 744.514155] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.514324] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.514427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.515143] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.515143] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.515267] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.515344] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.515581] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.516123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.516123] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.681830] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.841278] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa7cb676-7b51-4e93-980a-5540e7a7e88b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.891027] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-867 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.891027] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.891027] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.891027] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.891027] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.891027] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.891027] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.891960] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.892348] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.893096] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.893450] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 744.896018] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 744.896018] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 744.896018] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.896018] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 744.896018] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 744.920043] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 744.920043] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 744.920043] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 744.920043] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.920043] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-2c8368f5-9f36-4f8e-b5fc-d5fff209a5d5 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.920043] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-2c8368f5-9f36-4f8e-b5fc-d5fff209a5d5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.920043] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-2c8368f5-9f36-4f8e-b5fc-d5fff209a5d5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.920043] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-2c8368f5-9f36-4f8e-b5fc-d5fff209a5d5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.920043] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c8368f5-9f36-4f8e-b5fc-d5fff209a5d5',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.957803] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 in Status: SUCCESS [ 744.958050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.958808] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f10d7fb2-989f-41a7-941d-a5f2c98c1197 in Status: SUCCESS [ 744.959038] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f10d7fb2-989f-41a7-941d-a5f2c98c1197" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.959166] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.959463] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.959615] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.959798] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.959895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.960339] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.960402] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.960694] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.960694] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.962929] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f10d7fb2-989f-41a7-941d-a5f2c98c1197" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.968524] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f10d7fb2-989f-41a7-941d-a5f2c98c1197" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.968720] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.968810] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.968872] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.969092] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.969178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.969274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f10d7fb2-989f-41a7-941d-a5f2c98c1197" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.969391] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f10d7fb2-989f-41a7-941d-a5f2c98c1197',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.971375] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.971558] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.971840] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.974049] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.974234] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.974372] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.974498] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.974614] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.975551] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f10d7fb2-989f-41a7-941d-a5f2c98c1197" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.975756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f10d7fb2-989f-41a7-941d-a5f2c98c1197" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.975975] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.976159] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.976249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.976416] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.976496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.976600] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f10d7fb2-989f-41a7-941d-a5f2c98c1197',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.018514] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.018514] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.018514] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.018821] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.018864] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.019277] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.019426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.019578] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.019777] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.020051] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.020051] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eae2009-1124-44b2-a496-3582997767b0 already deleted. [ 745.020178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.184037] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.344333] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa7cb676-7b51-4e93-980a-5540e7a7e88b: rpc.has_security_group_logging(os_id): False [ 745.374450] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.374692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.374814] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.375119] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.375263] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.375586] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.375736] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.375846] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.376116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.376224] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.376371] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa7cb676-7b51-4e93-980a-5540e7a7e88b is going to be created. [ 745.423426] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.423711] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.423839] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.424151] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.424375] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.424726] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 2c8368f5-9f36-4f8e-b5fc-d5fff209a5d5 not found, creating... [ 745.425114] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.425285] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.425427] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.425732] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.425874] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.426203] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.426361] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.426471] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.426680] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.426805] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.426944] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 2c8368f5-9f36-4f8e-b5fc-d5fff209a5d5 is going to be created. [ 745.454930] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.455280] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.455500] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.455924] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.456295] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.456630] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-2c8368f5-9f36-4f8e-b5fc-d5fff209a5d5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.469903] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.470398] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.470579] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.470943] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.471262] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.472937] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bde2ba93-08d3-4359-9ce7-0ff97de68964 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.473128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.479296] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f10d7fb2-989f-41a7-941d-a5f2c98c1197',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.480464] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.481308] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.481434] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.481501] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.481708] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.481794] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.481982] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.482094] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.482155] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.482355] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.482435] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.482520] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f10d7fb2-989f-41a7-941d-a5f2c98c1197 is going to be deleted. [ 745.487083] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa7cb676-7b51-4e93-980a-5540e7a7e88b in Status: IN_PROGRESS for 2s [ 745.670711] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.670711] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.671402] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.671708] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.671870] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.671939] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f10d7fb2-989f-41a7-941d-a5f2c98c1197" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.686678] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.686857] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.686924] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.687193] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.687338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.687843] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 is going to be updated. [ 745.730700] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.730972] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.731069] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.731258] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.731460] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.746573] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: IN_PROGRESS for 2s [ 745.984974] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.986040] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f10d7fb2-989f-41a7-941d-a5f2c98c1197: rpc.has_security_group_logging(os_id): False [ 746.010349] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.010682] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.010682] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.011100] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.011100] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.011283] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.011416] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.011556] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.011698] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.011783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.011894] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f10d7fb2-989f-41a7-941d-a5f2c98c1197 is going to be created. [ 746.043020] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/f10d7fb2-989f-41a7-941d-a5f2c98c1197], does not exist path=[/infra/domains/default/groups/f10d7fb2-989f-41a7-941d-a5f2c98c1197]."\n}' [ 746.043181] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f10d7fb2-989f-41a7-941d-a5f2c98c1197 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f10d7fb2-989f-41a7-941d-a5f2c98c1197 [ 746.043284] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 746.081798] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.082077] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.082077] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.082460] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.083789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.084141] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.084343] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.084406] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.084655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.084655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.084979] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.085132] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.085239] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.085525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.085616] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.085721] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f10d7fb2-989f-41a7-941d-a5f2c98c1197 is going to be created. [ 746.111130] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/f10d7fb2-989f-41a7-941d-a5f2c98c1197], does not exist path=[/infra/domains/default/groups/f10d7fb2-989f-41a7-941d-a5f2c98c1197]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f10d7fb2-989f-41a7-941d-a5f2c98c1197 [ 746.111130] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f10d7fb2-989f-41a7-941d-a5f2c98c1197" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.111699] env[65322]: Traceback (most recent call last): [ 746.111760] env[65322]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 746.111760] env[65322]: return func(*args, **kwargs) [ 746.111760] env[65322]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 746.111760] env[65322]: res.raise_for_status() [ 746.111760] env[65322]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 746.111760] env[65322]: raise HTTPError(http_error_msg, response=self) [ 746.111760] env[65322]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f10d7fb2-989f-41a7-941d-a5f2c98c1197 [ 746.111760] env[65322]: During handling of the above exception, another exception occurred: [ 746.111760] env[65322]: Traceback (most recent call last): [ 746.111760] env[65322]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 746.111760] env[65322]: listener.cb(fileno) [ 746.111760] env[65322]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 746.111760] env[65322]: result = function(*args, **kwargs) [ 746.111760] env[65322]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 746.111760] env[65322]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 746.111760] env[65322]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 746.111760] env[65322]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 746.111760] env[65322]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 746.111760] env[65322]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 746.111760] env[65322]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 746.111760] env[65322]: res.raise_for_status() [ 746.112414] env[65322]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 746.112414] env[65322]: raise HTTPError(http_error_msg, response=self) [ 746.112414] env[65322]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f10d7fb2-989f-41a7-941d-a5f2c98c1197 [ 746.112414] env[65322]: Removing descriptor: 21 [ 746.251242] env[65322]: INFO networking_nsxv3.common.synchronization [req-d9806d30-eaf3-4b64-b05f-f045dde0cd9c req-af29cba3-de8f-40d0-9b56-a3f15e6703f8 service nova] Enqueued Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGHEST for action security_group_rules [ 746.251411] env[65322]: INFO networking_nsxv3.common.synchronization [req-d9806d30-eaf3-4b64-b05f-f045dde0cd9c req-af29cba3-de8f-40d0-9b56-a3f15e6703f8 service nova] Enqueued Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGHEST for action security_group_members [ 746.251940] env[65322]: INFO networking_nsxv3.common.synchronization [req-d9806d30-eaf3-4b64-b05f-f045dde0cd9c req-af29cba3-de8f-40d0-9b56-a3f15e6703f8 service nova] Enqueued Resource ID: 2c8368f5-9f36-4f8e-b5fc-d5fff209a5d5 with Priority: HIGHEST for action port [ 746.252149] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGHEST for action security_group_rules [ 746.252308] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGHEST for action security_group_members [ 746.252445] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8368f5-9f36-4f8e-b5fc-d5fff209a5d5 with Priority: HIGHEST for action port [ 746.252735] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.252867] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.252980] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.253317] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.253412] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.254318] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.255363] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.255363] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.255363] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.255363] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.255363] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.255363] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.259884] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.259884] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.259884] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.261365] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c8368f5-9f36-4f8e-b5fc-d5fff209a5d5 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.261365] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c8368f5-9f36-4f8e-b5fc-d5fff209a5d5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.261365] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c8368f5-9f36-4f8e-b5fc-d5fff209a5d5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.261365] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c8368f5-9f36-4f8e-b5fc-d5fff209a5d5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.261365] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c8368f5-9f36-4f8e-b5fc-d5fff209a5d5',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.323972] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: SUCCESS [ 746.324227] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.324569] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.324885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.325093] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.325264] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.325326] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.325679] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.325679] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.325788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.325986] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.326235] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.326291] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.326682] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.326840] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.326964] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.327082] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.327289] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.327415] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.327532] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.327674] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.329368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.329551] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.329691] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.330015] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.330015] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.331603] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.331603] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.331603] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.489335] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.490652] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.490652] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.490652] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.490652] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.490652] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 is going to be updated. [ 746.532813] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.532813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.532813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.532813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.532813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.552188] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 in Status: IN_PROGRESS for 2s [ 746.764501] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.764653] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.764888] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.766457] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c8368f5-9f36-4f8e-b5fc-d5fff209a5d5 with status ACTIVE [ 746.766734] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.766890] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.766956] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.767180] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.767265] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.767439] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.767534] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.767594] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.767753] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.767826] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.767996] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.768109] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.768221] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.768404] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.768632] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.768632] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c8368f5-9f36-4f8e-b5fc-d5fff209a5d5 is going to be updated. [ 746.808727] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.808936] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.808936] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.809168] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.809338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.809474] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c8368f5-9f36-4f8e-b5fc-d5fff209a5d5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.834230] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a07e97d-006e-4334-801f-7251980b19f1: rpc.has_security_group_logging(os_id): False [ 746.834230] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.867948] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.868263] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.868353] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.868581] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.868684] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.868955] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.869077] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.869145] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.869398] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.869504] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.869849] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.869959] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.869959] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.870544] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.870691] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.870940] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.871123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.871249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.871508] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.871634] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.871753] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a07e97d-006e-4334-801f-7251980b19f1 is going to be created. [ 746.965126] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.965610] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.965764] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.966020] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.966256] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.992355] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: IN_PROGRESS for 2s [ 747.268069] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.345162] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.507186] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa7cb676-7b51-4e93-980a-5540e7a7e88b in Status: SUCCESS [ 747.507662] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.768830] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: SUCCESS [ 747.768830] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.768830] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.768830] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.768830] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.769303] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.769303] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.769303] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.769465] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.769465] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.769564] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.770703] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.770874] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.770874] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.771710] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.771710] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.771710] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eae2009-1124-44b2-a496-3582997767b0 is going to be created. [ 747.805791] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.805984] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.807185] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.807504] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.807734] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.822140] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eae2009-1124-44b2-a496-3582997767b0 in Status: UNINITIALIZED for 2s [ 747.848630] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.848856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.848856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.849106] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.849176] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.849249] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a07e97d-006e-4334-801f-7251980b19f1 is going to be updated. [ 747.930924] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.931114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.931279] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.931485] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.931635] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.949241] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: IN_PROGRESS for 2s [ 748.273707] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.273945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.274061] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.275036] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.275036] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.275036] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.275036] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.275497] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.275497] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.275646] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.275927] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.276083] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.276186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.276549] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.276792] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.276941] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.277247] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.277452] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.277584] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.277719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.277857] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.567582] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 in Status: SUCCESS [ 748.567846] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.568115] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.568387] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.568707] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.568830] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.568912] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.569132] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.569225] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.569337] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.662721] env[65322]: INFO networking_nsxv3.common.synchronization [req-064ca829-42eb-4e2c-8a7f-b303baf2b271 req-d5a9edb8-c4d0-4d30-857c-d21db3b87679 tempest-SecurityGroupRulesTestJSON-623930063 tempest-SecurityGroupRulesTestJSON-623930063-project-member] Enqueued Resource ID: bebe9490-4ce3-4a50-bbb9-2911c1db36a7 with Priority: HIGHEST for action security_group_rules [ 748.663821] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bebe9490-4ce3-4a50-bbb9-2911c1db36a7 with Priority: HIGHEST for action security_group_rules [ 748.664464] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bebe9490-4ce3-4a50-bbb9-2911c1db36a7 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.664666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bebe9490-4ce3-4a50-bbb9-2911c1db36a7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.664716] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bebe9490-4ce3-4a50-bbb9-2911c1db36a7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.665089] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bebe9490-4ce3-4a50-bbb9-2911c1db36a7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.665176] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bebe9490-4ce3-4a50-bbb9-2911c1db36a7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.782486] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a34cfbc5-e3ce-4943-8058-702a82703915: rpc.has_security_group_logging(os_id): False [ 748.804699] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.804923] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.804998] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.805711] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.835429] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.835429] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.835429] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.836211] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.836211] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.836211] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.836211] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.836633] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.836633] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.836633] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.836633] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.836958] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.836958] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.836958] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.838489] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.838688] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.838735] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 is going to be updated. [ 748.911288] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.911426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.911494] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.911778] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.911952] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.936036] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: IN_PROGRESS for 2s [ 749.014198] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: SUCCESS [ 749.014873] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.014873] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.015112] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.015265] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.071589] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.189947] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.190287] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.190470] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.190838] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.191079] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.191271] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bebe9490-4ce3-4a50-bbb9-2911c1db36a7 already deleted. [ 749.191411] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bebe9490-4ce3-4a50-bbb9-2911c1db36a7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.517850] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.518053] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.577689] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.840763] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eae2009-1124-44b2-a496-3582997767b0 in Status: SUCCESS [ 749.841018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.841203] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.841510] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.841965] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.842145] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.842215] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.842461] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.842549] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.842640] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.842733] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.961285] env[65322]: INFO networking_nsxv3.common.synchronization [req-c2230a69-4ce3-40a2-89a3-aa6af12e3b56 req-ee367a3d-bcde-473c-aa79-e2b120589396 tempest-SecurityGroupRulesTestJSON-623930063 tempest-SecurityGroupRulesTestJSON-623930063-project-member] Enqueued Resource ID: bebe9490-4ce3-4a50-bbb9-2911c1db36a7 with Priority: HIGHEST for action security_group_rules [ 749.963308] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bebe9490-4ce3-4a50-bbb9-2911c1db36a7 with Priority: HIGHEST for action security_group_rules [ 749.963817] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bebe9490-4ce3-4a50-bbb9-2911c1db36a7 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.964016] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bebe9490-4ce3-4a50-bbb9-2911c1db36a7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.964200] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bebe9490-4ce3-4a50-bbb9-2911c1db36a7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.964487] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bebe9490-4ce3-4a50-bbb9-2911c1db36a7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.964601] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bebe9490-4ce3-4a50-bbb9-2911c1db36a7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.973183] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: SUCCESS [ 749.973817] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.973817] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.974047] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.974309] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.974490] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.974549] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.975084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.975084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.975084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.975316] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.083350] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.083350] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.083350] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.083350] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.083350] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.083350] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 is going to be updated. [ 750.114875] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.115332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.115332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.115332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.115808] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.125787] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 in Status: IN_PROGRESS for 2s [ 750.346093] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.346377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.346377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.346635] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.346807] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.346953] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.347067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.347196] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.347287] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.347377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.347548] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.347709] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.347709] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.348248] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.348407] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.348512] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.348578] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.348724] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.348819] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.348901] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.348993] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.478383] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.478756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.478882] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.479190] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.479493] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.479677] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.479829] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.480131] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.480290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.480577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.480876] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.481063] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.481170] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.481820] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.481820] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.481820] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.482141] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.482194] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.482365] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.482559] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.482664] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.502824] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.503049] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.503143] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.503767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.503767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.503767] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bebe9490-4ce3-4a50-bbb9-2911c1db36a7 already deleted. [ 750.504105] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bebe9490-4ce3-4a50-bbb9-2911c1db36a7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.825030] env[65322]: INFO networking_nsxv3.common.synchronization [req-e93bd5fc-75ad-4c89-b27f-589ea096e87a req-4e9f0e0c-59b7-4350-ade2-90018e0161bc tempest-ImagesOneServerNegativeTestJSON-1972759635 tempest-ImagesOneServerNegativeTestJSON-1972759635-project-member] Enqueued Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGHEST for action security_group_members [ 750.825030] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGHEST for action security_group_members [ 750.825030] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1550bb0-c88b-4864-824e-b80ca3b52834 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.825030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.825030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.825800] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.826157] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.826396] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.826536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.826787] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.826958] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.827175] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.853034] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4eae2009-1124-44b2-a496-3582997767b0: rpc.has_security_group_logging(os_id): False [ 750.874817] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.874948] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.875030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.875249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.875343] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.875554] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.875655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.875717] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.875860] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.875935] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.876136] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.876227] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.876286] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.876424] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.876496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.876681] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.876800] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.876864] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.877012] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.877715] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.877804] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4eae2009-1124-44b2-a496-3582997767b0 is going to be created. [ 750.958917] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.959120] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.959161] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.959421] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.959632] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.964142] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: SUCCESS [ 750.964337] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.983076] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eae2009-1124-44b2-a496-3582997767b0 in Status: IN_PROGRESS for 2s [ 750.985670] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a07e97d-006e-4334-801f-7251980b19f1: rpc.has_security_group_logging(os_id): False [ 751.018088] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.018358] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.018358] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.018637] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.018767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.019032] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.019144] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.019209] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.019395] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.019514] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.020029] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.020029] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.020219] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.020419] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.020542] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.020849] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.020923] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.020968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.021160] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.021278] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.021462] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a07e97d-006e-4334-801f-7251980b19f1 is going to be updated. [ 751.156375] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.156581] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.156581] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.157187] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.157187] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.175092] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: IN_PROGRESS for 2s [ 751.221320] env[65322]: INFO networking_nsxv3.common.synchronization [req-f8d8c636-a381-44e4-a9d3-75d837f5ca63 req-874a160e-0601-443c-b184-c0eb040f370e tempest-ServerRescueTestJSON-780090650 tempest-ServerRescueTestJSON-780090650-project-member] Enqueued Resource ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e with Priority: HIGHEST for action security_group_members [ 751.222633] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e with Priority: HIGHEST for action security_group_members [ 751.222633] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.222751] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.222751] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.223157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.223157] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.223309] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.223309] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.224032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.224032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.224032] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88219fc7-d04d-4a0f-88d0-399f8bd7ef8e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.331468] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.331666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.331744] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.332303] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.359114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.359114] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.359114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.359114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.359114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.359114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.359114] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1550bb0-c88b-4864-824e-b80ca3b52834 is going to be updated. [ 751.391279] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.391429] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.391500] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.391707] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.391846] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.401968] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1550bb0-c88b-4864-824e-b80ca3b52834 in Status: IN_PROGRESS for 2s [ 751.726071] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.726273] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.726351] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.726781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.751654] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.752060] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.752060] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.752357] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.752429] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.752545] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.752631] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e is going to be updated. [ 751.787922] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.788597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.788597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.790171] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.790820] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.802159] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e in Status: IN_PROGRESS for 2s [ 752.136538] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 in Status: SUCCESS [ 752.136915] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.137093] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.137386] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.137596] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.137720] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.137785] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.137938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.138050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.138142] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.138411] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bde2ba93-08d3-4359-9ce7-0ff97de68964 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.138411] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.138532] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.138626] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.138714] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.138800] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.138860] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.138994] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.139075] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.139150] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.139944] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.604560] env[65322]: INFO networking_nsxv3.common.synchronization [req-57e61aa4-dedb-45a5-aa59-bee1efb35bba req-30c1ed6b-fddd-4bf8-848b-705996dcde2e tempest-ImagesTestJSON-2080608290 tempest-ImagesTestJSON-2080608290-project-member] Enqueued Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 752.605864] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 752.606320] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.606503] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.606592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.606895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.607101] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.608085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.608085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.608085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.608085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.608085] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.641190] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bde2ba93-08d3-4359-9ce7-0ff97de68964: rpc.has_security_group_logging(os_id): False [ 752.663863] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.663988] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.664148] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.664637] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.692472] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.692845] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.693215] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.693215] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.693539] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.693674] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.693984] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.694106] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.694213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.694447] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.694639] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.694917] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.695769] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.695769] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.695769] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.695769] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.695769] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 is going to be updated. [ 752.790599] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.790787] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.790850] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.791024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.791167] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.809118] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 in Status: IN_PROGRESS for 2s [ 753.000907] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eae2009-1124-44b2-a496-3582997767b0 in Status: SUCCESS [ 753.001280] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.110548] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.111226] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.111226] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.111226] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.136907] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.137382] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.137382] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.137487] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.137690] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.137762] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.137858] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 is going to be updated. [ 753.173466] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.173652] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.173652] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.173888] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.174050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.187490] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: IN_PROGRESS for 2s [ 753.191549] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: SUCCESS [ 753.191657] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.191846] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.192188] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.192239] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.414812] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1550bb0-c88b-4864-824e-b80ca3b52834 in Status: SUCCESS [ 753.414984] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1550bb0-c88b-4864-824e-b80ca3b52834 deletion is rescheduled due to dependency. [ 753.415120] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.696532] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.696690] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.696762] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.696995] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.697181] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.697283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.697347] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.697498] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.697618] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.697722] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.697977] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.814012] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e in Status: SUCCESS [ 753.814199] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e deletion is rescheduled due to dependency. [ 753.814308] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.201429] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.201821] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.201821] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.202226] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.202477] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.202634] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.202727] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.203011] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.203157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.203371] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.203582] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.203762] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.203857] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.207572] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.207572] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.207572] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.207572] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.207572] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.207572] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.207572] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.207572] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.398183] env[65322]: INFO networking_nsxv3.common.synchronization [req-34e04d06-2b7a-4bba-a35c-eb6f833e9bf9 req-7d9e79a7-3ead-4e5b-9544-20633570a95b tempest-FloatingIPsAssociationTestJSON-408950981 tempest-FloatingIPsAssociationTestJSON-408950981-project-member] Enqueued Resource ID: 739eb2bf-8f60-406e-b099-1671d90b8545 with Priority: HIGHEST for action security_group_members [ 754.398907] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 739eb2bf-8f60-406e-b099-1671d90b8545 with Priority: HIGHEST for action security_group_members [ 754.399330] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-739eb2bf-8f60-406e-b099-1671d90b8545 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.399546] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.399663] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.400065] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.400353] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.401145] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.401145] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.401145] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.401145] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.401145] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('739eb2bf-8f60-406e-b099-1671d90b8545',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.710761] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a07e97d-006e-4334-801f-7251980b19f1: rpc.has_security_group_logging(os_id): False [ 754.738025] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.738025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.738025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.738025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.738025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.738025] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.738025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.738025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.738025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.738025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.738025] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.738025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.738025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.738025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.738025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.738899] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.738899] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.738899] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.738899] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.738899] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.738899] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a07e97d-006e-4334-801f-7251980b19f1 is going to be updated. [ 754.815863] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.815863] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.815863] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.815863] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.815863] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.830323] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 in Status: SUCCESS [ 754.830323] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.830323] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.830323] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.830821] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.832149] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: IN_PROGRESS for 2s [ 754.905063] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.905063] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.905063] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.905063] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.905063] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.905245] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.905245] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.905245] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.905601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.905601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.905601] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 739eb2bf-8f60-406e-b099-1671d90b8545 already deleted. [ 754.905690] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.030863] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-798 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.031155] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-798" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.031337] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-798" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.031766] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-798" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.032140] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.032366] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.032507] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.032927] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.033150] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.033432] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 755.034260] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 755.034724] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 755.034724] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 755.034801] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 755.034981] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 755.035116] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 755.063679] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 755.063862] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 755.063998] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 755.064250] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-798" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.064666] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-f4708187-55b1-45b2-9b79-e80c8b678669 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.064862] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-f4708187-55b1-45b2-9b79-e80c8b678669" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.065711] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-f4708187-55b1-45b2-9b79-e80c8b678669" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.066063] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-f4708187-55b1-45b2-9b79-e80c8b678669" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.066268] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4708187-55b1-45b2-9b79-e80c8b678669',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.199794] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: SUCCESS [ 755.199794] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 deletion is rescheduled due to dependency. [ 755.199794] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.333936] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bde2ba93-08d3-4359-9ce7-0ff97de68964 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.334477] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.334477] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.334609] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.334782] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.334903] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.334982] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.335177] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.335280] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.335371] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.335460] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.572507] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.572507] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.572507] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.572507] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.572507] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.572507] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port f4708187-55b1-45b2-9b79-e80c8b678669 not found, creating... [ 755.573112] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.573112] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.573112] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.573112] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.573345] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.573543] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.573673] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.573786] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.574012] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.574148] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.574292] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: f4708187-55b1-45b2-9b79-e80c8b678669 is going to be created. [ 755.608514] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.608820] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.608940] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.609258] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.609479] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.609711] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-f4708187-55b1-45b2-9b79-e80c8b678669" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.838369] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bde2ba93-08d3-4359-9ce7-0ff97de68964 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.838369] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.838369] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.838596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.838741] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.838901] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.838975] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.839148] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.839236] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.839327] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.839549] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bde2ba93-08d3-4359-9ce7-0ff97de68964 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.839654] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.839717] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.839875] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.840084] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.840242] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.840332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.840417] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.840495] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.840605] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.840722] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.343343] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bde2ba93-08d3-4359-9ce7-0ff97de68964: rpc.has_security_group_logging(os_id): False [ 756.364413] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.364576] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.364638] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.364858] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.364955] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.365194] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.365295] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.365360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.365513] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.365586] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.365760] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.365857] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.365916] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.366069] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.366256] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.366345] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.366399] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.366430] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.366568] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.366711] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.366711] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 is going to be updated. [ 756.427968] env[65322]: INFO networking_nsxv3.common.synchronization [req-34e04d06-2b7a-4bba-a35c-eb6f833e9bf9 req-a24d02d0-a8f1-49f7-ad49-3bb97cf15882 service nova] Enqueued Resource ID: 739eb2bf-8f60-406e-b099-1671d90b8545 with Priority: HIGHEST for action security_group_rules [ 756.428248] env[65322]: INFO networking_nsxv3.common.synchronization [req-34e04d06-2b7a-4bba-a35c-eb6f833e9bf9 req-a24d02d0-a8f1-49f7-ad49-3bb97cf15882 service nova] Enqueued Resource ID: 739eb2bf-8f60-406e-b099-1671d90b8545 with Priority: HIGHEST for action security_group_members [ 756.428500] env[65322]: INFO networking_nsxv3.common.synchronization [req-34e04d06-2b7a-4bba-a35c-eb6f833e9bf9 req-a24d02d0-a8f1-49f7-ad49-3bb97cf15882 service nova] Enqueued Resource ID: f4708187-55b1-45b2-9b79-e80c8b678669 with Priority: HIGHEST for action port [ 756.430142] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 739eb2bf-8f60-406e-b099-1671d90b8545 with Priority: HIGHEST for action security_group_rules [ 756.430368] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 739eb2bf-8f60-406e-b099-1671d90b8545 with Priority: HIGHEST for action security_group_members [ 756.430588] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4708187-55b1-45b2-9b79-e80c8b678669 with Priority: HIGHEST for action port [ 756.431052] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-739eb2bf-8f60-406e-b099-1671d90b8545 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.431181] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.431286] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.431725] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.431851] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('739eb2bf-8f60-406e-b099-1671d90b8545',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.437717] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-739eb2bf-8f60-406e-b099-1671d90b8545 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.437717] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.437717] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.437897] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.438155] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.438155] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.438268] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.438490] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.438615] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.440762] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('739eb2bf-8f60-406e-b099-1671d90b8545',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.443137] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4708187-55b1-45b2-9b79-e80c8b678669 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.443299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4708187-55b1-45b2-9b79-e80c8b678669" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.443427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4708187-55b1-45b2-9b79-e80c8b678669" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.443685] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4708187-55b1-45b2-9b79-e80c8b678669" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.443804] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4708187-55b1-45b2-9b79-e80c8b678669',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.448149] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.448149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.448149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.448149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.448610] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.469969] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 in Status: IN_PROGRESS for 2s [ 756.485994] env[65322]: INFO networking_nsxv3.common.synchronization [None req-0250766e-0e75-4375-900c-7a9b61b10819 None None] Enqueued Resource ID: 3d39cd1e-8b60-4cf8-96e4-c7321be99309 with Priority: HIGHEST for action port [ 756.486260] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d39cd1e-8b60-4cf8-96e4-c7321be99309 with Priority: HIGHEST for action port [ 756.486944] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d39cd1e-8b60-4cf8-96e4-c7321be99309 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.489071] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d39cd1e-8b60-4cf8-96e4-c7321be99309" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.489204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d39cd1e-8b60-4cf8-96e4-c7321be99309" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.489478] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d39cd1e-8b60-4cf8-96e4-c7321be99309" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.489584] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d39cd1e-8b60-4cf8-96e4-c7321be99309',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.760384] env[65322]: INFO networking_nsxv3.common.synchronization [req-a1b6ef6d-6aec-4345-84dd-4507f53387e2 req-fdef7767-4ea6-4535-be60-5b43f51367ab tempest-SecurityGroupRulesTestJSON-623930063 tempest-SecurityGroupRulesTestJSON-623930063-project-member] Enqueued Resource ID: bebe9490-4ce3-4a50-bbb9-2911c1db36a7 with Priority: HIGHEST for action security_group_rules [ 756.760965] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bebe9490-4ce3-4a50-bbb9-2911c1db36a7 with Priority: HIGHEST for action security_group_rules [ 756.761308] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bebe9490-4ce3-4a50-bbb9-2911c1db36a7 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.761403] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bebe9490-4ce3-4a50-bbb9-2911c1db36a7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.761403] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bebe9490-4ce3-4a50-bbb9-2911c1db36a7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.761603] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bebe9490-4ce3-4a50-bbb9-2911c1db36a7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.761678] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bebe9490-4ce3-4a50-bbb9-2911c1db36a7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.845904] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: SUCCESS [ 756.846146] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.937073] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-739eb2bf-8f60-406e-b099-1671d90b8545 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.937073] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.943883] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('739eb2bf-8f60-406e-b099-1671d90b8545',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.956041] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f4708187-55b1-45b2-9b79-e80c8b678669 with status ACTIVE [ 756.956041] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.956041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.956041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.956041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.956041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.956041] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.956041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.956041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.956041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.956041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.956041] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.956041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.956575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.956672] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.957727] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.957727] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f4708187-55b1-45b2-9b79-e80c8b678669 is going to be updated. [ 756.984315] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.984484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.984484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.984654] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.985149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.985149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4708187-55b1-45b2-9b79-e80c8b678669" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.994988] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d39cd1e-8b60-4cf8-96e4-c7321be99309 [ 756.996837] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.997227] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.997227] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.997898] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.997898] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.997898] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d39cd1e-8b60-4cf8-96e4-c7321be99309 already deleted. [ 756.997898] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d39cd1e-8b60-4cf8-96e4-c7321be99309" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.291056] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.291056] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.291056] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.291056] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.291729] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.291729] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bebe9490-4ce3-4a50-bbb9-2911c1db36a7 already deleted. [ 757.291729] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bebe9490-4ce3-4a50-bbb9-2911c1db36a7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.447332] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('739eb2bf-8f60-406e-b099-1671d90b8545',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.951281] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.951281] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.951281] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.951281] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.951281] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.951563] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 739eb2bf-8f60-406e-b099-1671d90b8545 is going to be created. [ 757.984372] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.984372] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.984372] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.984372] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.984372] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.992703] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 739eb2bf-8f60-406e-b099-1671d90b8545 in Status: UNINITIALIZED for 2s [ 758.485171] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 in Status: SUCCESS [ 758.485684] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.607145] env[65322]: INFO networking_nsxv3.common.synchronization [req-842882fb-c3c8-4249-bba7-8da6fc23463e req-f1ce18ae-c79f-49aa-971b-07d58b5bbd66 tempest-ListServerFiltersTestJSON-548115459 tempest-ListServerFiltersTestJSON-548115459-project-member] Enqueued Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGHEST for action security_group_members [ 758.607874] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGHEST for action security_group_members [ 758.608977] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.609375] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.609498] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.609746] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.610567] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.610567] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.610712] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.610876] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.611079] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.611233] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.114118] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.299840] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-867 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.300826] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.301043] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.301807] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.302277] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.302597] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.302792] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.303167] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.304173] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.304473] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.304589] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 759.304732] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 759.304834] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 759.304956] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 759.305076] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 759.305346] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 759.332669] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 759.332669] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 759.332669] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 759.332669] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.333287] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-f8413935-d6dc-4075-815c-d24afc3889fd taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.333287] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-f8413935-d6dc-4075-815c-d24afc3889fd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.333465] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-f8413935-d6dc-4075-815c-d24afc3889fd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.333697] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-f8413935-d6dc-4075-815c-d24afc3889fd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.333857] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8413935-d6dc-4075-815c-d24afc3889fd',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.437058] env[65322]: INFO networking_nsxv3.common.synchronization [None req-cff6a977-6c7a-4594-aa25-e47a68f015cd None None] Enqueued Resource ID: c7933227-ec36-4d91-b61e-3e7c91484133 with Priority: HIGHEST for action port [ 759.437887] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7933227-ec36-4d91-b61e-3e7c91484133 with Priority: HIGHEST for action port [ 759.438142] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7933227-ec36-4d91-b61e-3e7c91484133 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.438271] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7933227-ec36-4d91-b61e-3e7c91484133" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.438340] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7933227-ec36-4d91-b61e-3e7c91484133" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.438618] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7933227-ec36-4d91-b61e-3e7c91484133" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.438704] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7933227-ec36-4d91-b61e-3e7c91484133',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.616344] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.839598] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.840426] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.840426] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.840632] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.840829] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.842586] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port f8413935-d6dc-4075-815c-d24afc3889fd not found, creating... [ 759.842586] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.842586] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.842586] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.843778] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.844945] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.845934] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.846383] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.846492] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.846755] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.846919] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.847182] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: f8413935-d6dc-4075-815c-d24afc3889fd is going to be created. [ 759.883759] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.883970] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.884110] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.884389] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.884609] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.884859] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-f8413935-d6dc-4075-815c-d24afc3889fd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.940650] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c7933227-ec36-4d91-b61e-3e7c91484133 [ 759.940862] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.940992] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.941078] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.941310] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.941395] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.941487] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c7933227-ec36-4d91-b61e-3e7c91484133 already deleted. [ 759.941561] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7933227-ec36-4d91-b61e-3e7c91484133" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.014049] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 739eb2bf-8f60-406e-b099-1671d90b8545 in Status: SUCCESS [ 760.014922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.014922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.015644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.015828] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.016425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.016542] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.016773] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.017278] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.017855] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.018287] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('739eb2bf-8f60-406e-b099-1671d90b8545',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.120843] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.120999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.121080] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.121395] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.121536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.121686] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eae2009-1124-44b2-a496-3582997767b0 is going to be updated. [ 760.158770] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.159719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.159719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.159719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.159719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.171101] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eae2009-1124-44b2-a496-3582997767b0 in Status: IN_PROGRESS for 2s [ 760.275851] env[65322]: INFO networking_nsxv3.common.synchronization [None req-bd9c9b15-30de-4f3c-bc3b-a06921cbfbc9 None None] Enqueued Resource ID: 9d88fe15-92ed-4011-a888-4f95209cb445 with Priority: HIGHEST for action port [ 760.275851] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d88fe15-92ed-4011-a888-4f95209cb445 with Priority: HIGHEST for action port [ 760.275851] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d88fe15-92ed-4011-a888-4f95209cb445 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.276105] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d88fe15-92ed-4011-a888-4f95209cb445" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.276105] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d88fe15-92ed-4011-a888-4f95209cb445" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.276363] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d88fe15-92ed-4011-a888-4f95209cb445" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.276496] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d88fe15-92ed-4011-a888-4f95209cb445',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.522096] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-739eb2bf-8f60-406e-b099-1671d90b8545 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.522096] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.522096] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.522432] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.522432] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.522432] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.522582] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.522670] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.522763] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.522855] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.522997] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-739eb2bf-8f60-406e-b099-1671d90b8545 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.523104] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.523161] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.523323] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.523484] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.523582] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.523640] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.523822] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.523913] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.523997] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.524120] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('739eb2bf-8f60-406e-b099-1671d90b8545',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.583620] env[65322]: INFO networking_nsxv3.common.synchronization [req-842882fb-c3c8-4249-bba7-8da6fc23463e req-700d8cce-8b93-4b4d-a238-960287582359 service nova] Enqueued Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGHEST for action security_group_rules [ 760.583620] env[65322]: INFO networking_nsxv3.common.synchronization [req-842882fb-c3c8-4249-bba7-8da6fc23463e req-700d8cce-8b93-4b4d-a238-960287582359 service nova] Enqueued Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGHEST for action security_group_members [ 760.583620] env[65322]: INFO networking_nsxv3.common.synchronization [req-842882fb-c3c8-4249-bba7-8da6fc23463e req-700d8cce-8b93-4b4d-a238-960287582359 service nova] Enqueued Resource ID: f8413935-d6dc-4075-815c-d24afc3889fd with Priority: HIGHEST for action port [ 760.585398] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGHEST for action security_group_rules [ 760.585639] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGHEST for action security_group_members [ 760.585769] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8413935-d6dc-4075-815c-d24afc3889fd with Priority: HIGHEST for action port [ 760.586116] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.586295] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.586393] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.586875] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.587017] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.588389] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.588532] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.588854] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8413935-d6dc-4075-815c-d24afc3889fd taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.589088] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8413935-d6dc-4075-815c-d24afc3889fd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.589297] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8413935-d6dc-4075-815c-d24afc3889fd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.590044] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8413935-d6dc-4075-815c-d24afc3889fd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.590044] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8413935-d6dc-4075-815c-d24afc3889fd',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.781870] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d88fe15-92ed-4011-a888-4f95209cb445 [ 760.781870] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.781870] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.781870] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.782542] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.782542] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.782542] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d88fe15-92ed-4011-a888-4f95209cb445 already deleted. [ 760.782542] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d88fe15-92ed-4011-a888-4f95209cb445" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.026905] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 739eb2bf-8f60-406e-b099-1671d90b8545: rpc.has_security_group_logging(os_id): False [ 761.049108] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.049296] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.050109] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.050383] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.051033] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.051033] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.051259] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.051259] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.051361] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.051477] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.052849] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.052849] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.052849] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.052849] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.052849] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.052849] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.052849] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.052849] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.052849] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.053328] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.053328] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 739eb2bf-8f60-406e-b099-1671d90b8545 is going to be created. [ 761.092386] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.092695] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.093030] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8413935-d6dc-4075-815c-d24afc3889fd with status ACTIVE [ 761.094808] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.094808] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.094808] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.094808] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.094808] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.094808] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.094808] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.094808] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.094808] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.094808] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.094808] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.094808] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.095607] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.095607] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.095607] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.095607] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8413935-d6dc-4075-815c-d24afc3889fd is going to be updated. [ 761.123610] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.123841] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.123841] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.124037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.124174] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.124404] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8413935-d6dc-4075-815c-d24afc3889fd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.132536] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.132536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.132536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.132536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.132536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.144606] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 739eb2bf-8f60-406e-b099-1671d90b8545 in Status: IN_PROGRESS for 2s [ 762.183258] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eae2009-1124-44b2-a496-3582997767b0 in Status: SUCCESS [ 762.183803] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.183803] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.183878] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.184052] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.184175] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.184234] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.184426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.184511] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.184608] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.607167] env[65322]: INFO networking_nsxv3.common.synchronization [None req-8406517b-a549-43bc-a67e-4f2159de7bc0 tempest-AttachVolumeShelveTestJSON-315803451 tempest-AttachVolumeShelveTestJSON-315803451-project-member] Enqueued Resource ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 with Priority: HIGHEST for action security_group_rules [ 762.609171] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 with Priority: HIGHEST for action security_group_rules [ 762.609171] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbf21d11-c10d-47fc-811b-f6af5267a9d6 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.609171] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.609651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.609683] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.610155] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbf21d11-c10d-47fc-811b-f6af5267a9d6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.688155] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.791700] env[65322]: INFO networking_nsxv3.common.synchronization [None req-325a2e21-566c-4b01-88bb-9c5482fe5ca2 tempest-AttachVolumeShelveTestJSON-315803451 tempest-AttachVolumeShelveTestJSON-315803451-project-member] Enqueued Resource ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 with Priority: HIGHEST for action security_group_rules [ 762.792520] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 with Priority: HIGHEST for action security_group_rules [ 762.792829] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbf21d11-c10d-47fc-811b-f6af5267a9d6 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.792927] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.133918] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.134156] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.134156] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.134433] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.134588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.134746] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 already deleted. [ 763.134851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.135259] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.136285] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.136378] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbf21d11-c10d-47fc-811b-f6af5267a9d6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.163034] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 739eb2bf-8f60-406e-b099-1671d90b8545 in Status: SUCCESS [ 763.163147] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.192168] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.218612] env[65322]: INFO networking_nsxv3.common.synchronization [None req-7a614947-c43f-4474-bd05-8ed56bb9e03f None None] Enqueued Resource ID: bcccd571-182a-4939-8936-2d083c012e1c with Priority: HIGHEST for action port [ 763.219239] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcccd571-182a-4939-8936-2d083c012e1c with Priority: HIGHEST for action port [ 763.219636] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcccd571-182a-4939-8936-2d083c012e1c taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.219862] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcccd571-182a-4939-8936-2d083c012e1c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.219965] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcccd571-182a-4939-8936-2d083c012e1c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.221967] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcccd571-182a-4939-8936-2d083c012e1c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.222256] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcccd571-182a-4939-8936-2d083c012e1c',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.657324] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.657522] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.657522] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.657742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.658107] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.658107] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 already deleted. [ 763.658107] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.696139] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.696300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.696405] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.696633] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.696722] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.697140] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eae2009-1124-44b2-a496-3582997767b0 is going to be updated. [ 763.727310] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.727461] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.727461] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.727666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.729063] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.730153] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bcccd571-182a-4939-8936-2d083c012e1c [ 763.730327] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.730443] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.730573] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.730697] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.730756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.730846] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bcccd571-182a-4939-8936-2d083c012e1c already deleted. [ 763.730923] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcccd571-182a-4939-8936-2d083c012e1c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.741779] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eae2009-1124-44b2-a496-3582997767b0 in Status: IN_PROGRESS for 2s [ 764.813046] env[65322]: INFO networking_nsxv3.common.synchronization [req-dccaac89-9ae6-4fcf-8cd0-3890955eced8 req-f0347489-deed-476b-87e4-51ae32d93aae tempest-VolumesAssistedSnapshotsTest-1934724153 tempest-VolumesAssistedSnapshotsTest-1934724153-project-member] Enqueued Resource ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 with Priority: HIGHEST for action security_group_members [ 764.813650] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 with Priority: HIGHEST for action security_group_members [ 764.814013] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3b868ada-e2d6-41f0-b807-c024a41e03d9 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.814419] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.814519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.814702] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.814866] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.815076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.815117] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.816012] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.816085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.816223] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3b868ada-e2d6-41f0-b807-c024a41e03d9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.984126] env[65322]: INFO networking_nsxv3.common.synchronization [req-faf57c87-eb05-470a-8caf-541b7f00da69 req-dddb5106-dc94-48ae-bf51-c0c76ddcb819 tempest-ServerRescueTestJSONUnderV235-515906475 tempest-ServerRescueTestJSONUnderV235-515906475-project-member] Enqueued Resource ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 with Priority: HIGHEST for action security_group_members [ 764.984767] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 with Priority: HIGHEST for action security_group_members [ 764.985470] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bde2ba93-08d3-4359-9ce7-0ff97de68964 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.985618] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.985685] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.985911] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.986029] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.986123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.986216] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.986484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.986554] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.986649] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bde2ba93-08d3-4359-9ce7-0ff97de68964',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.320084] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.320084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.320084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.320084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.347463] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.347732] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.348839] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.348839] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.348978] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.349035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.349133] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 is going to be updated. [ 765.378051] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.380014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.380014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.380014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.380014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.388640] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 in Status: IN_PROGRESS for 2s [ 765.489742] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.490264] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.490264] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.493021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.493021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.493021] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.493021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.493021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.493021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.493021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.493021] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 is going to be updated. [ 765.535175] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.535608] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.535715] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.535975] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.536262] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.548305] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 in Status: IN_PROGRESS for 2s [ 765.601173] env[65322]: INFO networking_nsxv3.common.synchronization [req-31164279-43d1-47f7-870f-ff7f2e785c4e req-879d3f72-b295-4d37-b55f-44d9db75d148 tempest-ServersTestMultiNic-1695456669 tempest-ServersTestMultiNic-1695456669-project-member] Enqueued Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 765.601859] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 765.603265] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.603815] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.603815] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.603941] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.604071] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.605642] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.605866] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.606209] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.606389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.606597] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.753544] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eae2009-1124-44b2-a496-3582997767b0 in Status: SUCCESS [ 765.753544] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.753544] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.753544] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.753793] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.753902] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.753902] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.754045] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.754130] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.754213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.754441] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.873698] env[65322]: INFO networking_nsxv3.common.synchronization [req-31164279-43d1-47f7-870f-ff7f2e785c4e req-2718c921-e655-4231-ba85-2b0f96c485fb tempest-ServersTestMultiNic-1695456669 tempest-ServersTestMultiNic-1695456669-project-member] Enqueued Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 765.874594] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 765.874932] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.875073] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.110219] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.258527] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.258685] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.258733] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.258958] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.259140] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.260368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.260368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.260368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.260368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.260368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.260368] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.260368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.260368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.260368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.260368] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.260840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.260840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.260840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.260840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.260840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.260840] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.264849] env[65322]: INFO networking_nsxv3.common.synchronization [req-31164279-43d1-47f7-870f-ff7f2e785c4e req-84ce87fc-75de-43a4-a395-d38831927d8d tempest-ServersTestMultiNic-1695456669 tempest-ServersTestMultiNic-1695456669-project-member] Enqueued Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 766.265540] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 766.266298] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.266298] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.615019] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.767885] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4eae2009-1124-44b2-a496-3582997767b0: rpc.has_security_group_logging(os_id): False [ 766.790329] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.790329] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.790329] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.790526] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.790652] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.791052] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.791052] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.791052] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.791207] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.791237] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.791721] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.791721] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.791721] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.793311] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.793311] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.793433] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.793521] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.793632] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.793748] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.794111] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.794111] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4eae2009-1124-44b2-a496-3582997767b0 is going to be updated. [ 766.863027] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.863027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.863027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.863027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.863027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.885980] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eae2009-1124-44b2-a496-3582997767b0 in Status: IN_PROGRESS for 2s [ 767.116967] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.117249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.117249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.120155] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.120155] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.120155] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a07e97d-006e-4334-801f-7251980b19f1 is going to be updated. [ 767.150873] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.151347] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.151859] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.152288] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.152288] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.165537] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: IN_PROGRESS for 2s [ 767.273046] env[65322]: INFO networking_nsxv3.common.synchronization [req-80a42705-da08-4b5c-8821-00ab5daecb6e req-f8eaed69-74b6-4b39-8505-47990aaa410c tempest-DeleteServersTestJSON-1463403857 tempest-DeleteServersTestJSON-1463403857-project-member] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 767.273703] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 767.274015] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.274630] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.274902] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.275555] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.275915] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.276095] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.276182] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.276383] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.276643] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.276677] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.400080] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 in Status: SUCCESS [ 767.400080] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 deletion is rescheduled due to dependency. [ 767.400787] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.559436] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 in Status: SUCCESS [ 767.559436] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bde2ba93-08d3-4359-9ce7-0ff97de68964 deletion is rescheduled due to dependency. [ 767.559436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bde2ba93-08d3-4359-9ce7-0ff97de68964" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.781462] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.781462] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.781462] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.781462] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.781462] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.781462] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.781462] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.781462] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.781462] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.781462] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.781997] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 already deleted. [ 767.781997] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.831780] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.832063] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.832250] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.832678] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.833037] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.833179] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.833324] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.833601] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.833777] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.834023] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.834168] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 767.834233] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 767.834339] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 767.834440] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 767.834540] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 767.834703] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 767.854914] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 767.855109] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 767.855281] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 767.855408] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.855727] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-a3433b94-5628-4094-b235-9354f5fed5b0 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.855891] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-a3433b94-5628-4094-b235-9354f5fed5b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.856013] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-a3433b94-5628-4094-b235-9354f5fed5b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.856347] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-a3433b94-5628-4094-b235-9354f5fed5b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.856471] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3433b94-5628-4094-b235-9354f5fed5b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.360485] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.360814] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.360814] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.361119] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.361908] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.361908] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port a3433b94-5628-4094-b235-9354f5fed5b0 not found, creating... [ 768.361908] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.361908] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.361908] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.362142] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.362177] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.362462] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.362586] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.362697] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.362890] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.363017] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.363149] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: a3433b94-5628-4094-b235-9354f5fed5b0 is going to be created. [ 768.385432] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.385682] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.385803] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.386077] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.386296] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.386508] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-a3433b94-5628-4094-b235-9354f5fed5b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.911822] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eae2009-1124-44b2-a496-3582997767b0 in Status: SUCCESS [ 768.911822] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.118642] env[65322]: INFO networking_nsxv3.common.synchronization [req-80a42705-da08-4b5c-8821-00ab5daecb6e req-b69985ec-ccd4-41b0-b7aa-e771447616e6 service nova] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_rules [ 769.118813] env[65322]: INFO networking_nsxv3.common.synchronization [req-80a42705-da08-4b5c-8821-00ab5daecb6e req-b69985ec-ccd4-41b0-b7aa-e771447616e6 service nova] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 769.118937] env[65322]: INFO networking_nsxv3.common.synchronization [req-80a42705-da08-4b5c-8821-00ab5daecb6e req-b69985ec-ccd4-41b0-b7aa-e771447616e6 service nova] Enqueued Resource ID: a3433b94-5628-4094-b235-9354f5fed5b0 with Priority: HIGHEST for action port [ 769.119181] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_rules [ 769.119307] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 769.119400] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3433b94-5628-4094-b235-9354f5fed5b0 with Priority: HIGHEST for action port [ 769.119988] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.120357] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.120520] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.120805] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.120932] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.122572] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.122757] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.122855] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.123097] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.123337] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.123456] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.123575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.123720] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.123835] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.124068] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.127229] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3433b94-5628-4094-b235-9354f5fed5b0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.130209] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3433b94-5628-4094-b235-9354f5fed5b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.130209] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3433b94-5628-4094-b235-9354f5fed5b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.130209] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3433b94-5628-4094-b235-9354f5fed5b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.130209] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3433b94-5628-4094-b235-9354f5fed5b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.176928] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: SUCCESS [ 769.177409] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.177755] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.178087] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.178821] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.178821] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.178821] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.179024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.179264] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.179325] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.561836] env[65322]: INFO networking_nsxv3.common.synchronization [req-1eeff516-4303-4874-9eb4-b3ae1bb410fb req-af7b5e6f-e313-45a3-9101-c6c097ace079 tempest-ServersTestFqdnHostnames-1357520545 tempest-ServersTestFqdnHostnames-1357520545-project-member] Enqueued Resource ID: b43d5c58-0cb4-4f14-b009-7fe58147ee41 with Priority: HIGHEST for action security_group_members [ 769.562375] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b43d5c58-0cb4-4f14-b009-7fe58147ee41 with Priority: HIGHEST for action security_group_members [ 769.562510] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-b43d5c58-0cb4-4f14-b009-7fe58147ee41 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.562673] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.562673] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.562841] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.563012] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.563274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.563338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.563537] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.563669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.563787] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b43d5c58-0cb4-4f14-b009-7fe58147ee41',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.623608] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.623753] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.628383] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.632485] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a3433b94-5628-4094-b235-9354f5fed5b0 with status ACTIVE [ 769.632485] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.632485] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.632485] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.632485] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.632485] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.632485] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.632485] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.632485] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.632485] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.633386] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.633386] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.633386] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.633386] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.633386] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.633386] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.633386] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a3433b94-5628-4094-b235-9354f5fed5b0 is going to be updated. [ 769.655546] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.655728] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.655794] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.655999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.656630] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.656630] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3433b94-5628-4094-b235-9354f5fed5b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.682065] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.683081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.683157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.683372] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.683484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.683710] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.683818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.683882] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.684067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.684947] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.685179] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a07e97d-006e-4334-801f-7251980b19f1 is going to be updated. [ 769.722675] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.722812] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.722853] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.723068] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.723308] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.736233] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: IN_PROGRESS for 2s [ 770.067552] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.067757] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.067836] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.068126] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.091275] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.091705] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.091705] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.091848] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.092429] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.092429] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.092429] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b43d5c58-0cb4-4f14-b009-7fe58147ee41 is going to be updated. [ 770.117758] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.117908] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.117979] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.118211] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.118343] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.126986] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b43d5c58-0cb4-4f14-b009-7fe58147ee41 in Status: IN_PROGRESS for 2s [ 770.130635] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.250889] env[65322]: INFO networking_nsxv3.common.synchronization [req-e271360a-7bf3-4d9e-a1b4-e3b24dea9aab req-a3aba68d-6bfb-4c8b-9113-239e51e98f53 tempest-MigrationsAdminTest-1504175931 tempest-MigrationsAdminTest-1504175931-project-member] Enqueued Resource ID: 26df6822-523e-4c95-9d74-db0cddb065c0 with Priority: HIGHEST for action security_group_members [ 770.251671] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26df6822-523e-4c95-9d74-db0cddb065c0 with Priority: HIGHEST for action security_group_members [ 770.251867] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-26df6822-523e-4c95-9d74-db0cddb065c0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.252068] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.252176] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.252498] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.252733] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.252820] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.252859] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.253087] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.253308] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.253308] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26df6822-523e-4c95-9d74-db0cddb065c0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.633166] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.634128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.634128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.634128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.634128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.634128] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be created. [ 770.658307] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.658508] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.658508] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.658726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.658882] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.670023] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: UNINITIALIZED for 2s [ 770.756977] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('26df6822-523e-4c95-9d74-db0cddb065c0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.761919] env[65322]: INFO networking_nsxv3.common.synchronization [None req-b075059e-6142-4a8e-b3a3-3b04099f4b66 None None] Enqueued Resource ID: bb884d05-3e47-44a0-a3ef-529614b8bba0 with Priority: HIGHEST for action port [ 770.763616] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb884d05-3e47-44a0-a3ef-529614b8bba0 with Priority: HIGHEST for action port [ 770.763616] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb884d05-3e47-44a0-a3ef-529614b8bba0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.763616] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb884d05-3e47-44a0-a3ef-529614b8bba0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.763616] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb884d05-3e47-44a0-a3ef-529614b8bba0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.763928] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb884d05-3e47-44a0-a3ef-529614b8bba0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.763928] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb884d05-3e47-44a0-a3ef-529614b8bba0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.854019] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-620 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.854019] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.854019] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.854019] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.854019] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.854019] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.854019] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.854019] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.854019] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.854628] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 770.854841] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 770.855173] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 770.855392] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 770.855606] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 770.855787] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 770.855986] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 770.877045] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 770.877045] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 770.877045] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 770.877045] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.877045] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-f2f121e6-e0ed-40aa-ad93-dd2cc85a356f taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.877045] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-f2f121e6-e0ed-40aa-ad93-dd2cc85a356f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.877442] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-f2f121e6-e0ed-40aa-ad93-dd2cc85a356f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.877475] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-f2f121e6-e0ed-40aa-ad93-dd2cc85a356f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.877633] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2f121e6-e0ed-40aa-ad93-dd2cc85a356f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.263374] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('26df6822-523e-4c95-9d74-db0cddb065c0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.267432] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb884d05-3e47-44a0-a3ef-529614b8bba0 [ 771.267560] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.267653] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.267653] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.267885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.267992] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.268089] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb884d05-3e47-44a0-a3ef-529614b8bba0 already deleted. [ 771.268181] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb884d05-3e47-44a0-a3ef-529614b8bba0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.383023] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.383023] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.383023] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.383023] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.383023] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.383023] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port f2f121e6-e0ed-40aa-ad93-dd2cc85a356f not found, creating... [ 771.383023] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.383023] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.383023] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.383023] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.383023] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.383713] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.383889] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.384012] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.384254] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.384403] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.384538] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: f2f121e6-e0ed-40aa-ad93-dd2cc85a356f is going to be created. [ 771.415221] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.415221] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.415221] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.415221] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.415221] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.415221] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-f2f121e6-e0ed-40aa-ad93-dd2cc85a356f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.749599] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: SUCCESS [ 771.749909] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a07e97d-006e-4334-801f-7251980b19f1 deletion is rescheduled due to dependency. [ 771.749909] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.750070] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.750299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.750571] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.750763] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.750828] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.750998] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.751103] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.751197] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.767542] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.767680] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.767755] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.767971] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.768543] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.768618] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26df6822-523e-4c95-9d74-db0cddb065c0 is going to be updated. [ 771.798759] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.798759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.798759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.799034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.799185] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.809015] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26df6822-523e-4c95-9d74-db0cddb065c0 in Status: IN_PROGRESS for 2s [ 772.137803] env[65322]: INFO networking_nsxv3.common.synchronization [req-e271360a-7bf3-4d9e-a1b4-e3b24dea9aab req-0d6ff941-094d-4975-ade0-a77224d51d6c service nova] Enqueued Resource ID: 26df6822-523e-4c95-9d74-db0cddb065c0 with Priority: HIGHEST for action security_group_rules [ 772.137981] env[65322]: INFO networking_nsxv3.common.synchronization [req-e271360a-7bf3-4d9e-a1b4-e3b24dea9aab req-0d6ff941-094d-4975-ade0-a77224d51d6c service nova] Enqueued Resource ID: 26df6822-523e-4c95-9d74-db0cddb065c0 with Priority: HIGHEST for action security_group_members [ 772.138121] env[65322]: INFO networking_nsxv3.common.synchronization [req-e271360a-7bf3-4d9e-a1b4-e3b24dea9aab req-0d6ff941-094d-4975-ade0-a77224d51d6c service nova] Enqueued Resource ID: f2f121e6-e0ed-40aa-ad93-dd2cc85a356f with Priority: HIGHEST for action port [ 772.139059] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b43d5c58-0cb4-4f14-b009-7fe58147ee41 in Status: SUCCESS [ 772.139204] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b43d5c58-0cb4-4f14-b009-7fe58147ee41 deletion is rescheduled due to dependency. [ 772.139317] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b43d5c58-0cb4-4f14-b009-7fe58147ee41" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.139628] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26df6822-523e-4c95-9d74-db0cddb065c0 with Priority: HIGHEST for action security_group_rules [ 772.139628] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26df6822-523e-4c95-9d74-db0cddb065c0 with Priority: HIGHEST for action security_group_members [ 772.139733] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2f121e6-e0ed-40aa-ad93-dd2cc85a356f with Priority: HIGHEST for action port [ 772.140234] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26df6822-523e-4c95-9d74-db0cddb065c0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.140360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.140431] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.140661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.140719] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26df6822-523e-4c95-9d74-db0cddb065c0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.141535] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-26df6822-523e-4c95-9d74-db0cddb065c0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.141639] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.142047] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2f121e6-e0ed-40aa-ad93-dd2cc85a356f taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.142047] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2f121e6-e0ed-40aa-ad93-dd2cc85a356f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.142047] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2f121e6-e0ed-40aa-ad93-dd2cc85a356f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.142178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2f121e6-e0ed-40aa-ad93-dd2cc85a356f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.142227] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2f121e6-e0ed-40aa-ad93-dd2cc85a356f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.255221] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.257856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.257856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.257856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.257856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.257856] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.257856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.257856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.257856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.257856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.257856] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a07e97d-006e-4334-801f-7251980b19f1 is going to be updated. [ 772.296927] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.297135] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.297177] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.298206] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.298206] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.308686] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: IN_PROGRESS for 2s [ 772.644223] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-26df6822-523e-4c95-9d74-db0cddb065c0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.644223] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.645244] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2f121e6-e0ed-40aa-ad93-dd2cc85a356f with status ACTIVE [ 772.645412] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.645585] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.645651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.645830] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.645922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.646105] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.646203] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.646264] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.646450] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.646493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.646654] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.646752] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.646822] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.646946] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.647058] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.647105] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2f121e6-e0ed-40aa-ad93-dd2cc85a356f is going to be updated. [ 772.672243] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.672369] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.672369] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.672629] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.672778] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.672958] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2f121e6-e0ed-40aa-ad93-dd2cc85a356f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.684881] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: SUCCESS [ 772.685134] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.685292] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.685520] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.685844] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.685844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.685977] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.686127] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.686211] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.686299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.686390] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.748398] env[65322]: INFO networking_nsxv3.common.synchronization [None req-505b358b-e139-47d4-bf74-6b1e78a9ce29 None None] Enqueued Resource ID: 2e1525f2-f080-4ea0-a452-43e7bbb5cc53 with Priority: HIGHEST for action port [ 772.749111] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e1525f2-f080-4ea0-a452-43e7bbb5cc53 with Priority: HIGHEST for action port [ 772.754326] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e1525f2-f080-4ea0-a452-43e7bbb5cc53 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.754326] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e1525f2-f080-4ea0-a452-43e7bbb5cc53" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.754326] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e1525f2-f080-4ea0-a452-43e7bbb5cc53" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.754740] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e1525f2-f080-4ea0-a452-43e7bbb5cc53" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.754740] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e1525f2-f080-4ea0-a452-43e7bbb5cc53',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.193117] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.193117] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.193117] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.193117] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.193117] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.193117] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.193117] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.194207] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.194409] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.194592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.195483] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.195776] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.195776] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.196735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.196735] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.196735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.196735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.196735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.196735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.196735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.196735] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.258880] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e1525f2-f080-4ea0-a452-43e7bbb5cc53 [ 773.258880] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.259108] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.259108] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.259321] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.259387] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.259491] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e1525f2-f080-4ea0-a452-43e7bbb5cc53 already deleted. [ 773.259823] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e1525f2-f080-4ea0-a452-43e7bbb5cc53" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.701307] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e863a544-814a-4bca-b4b1-35f9a61afcd3: rpc.has_security_group_logging(os_id): False [ 773.723177] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.723545] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.723545] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.723808] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.723982] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.724401] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.724499] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.724561] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.726683] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.728752] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.728752] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.729136] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.729365] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.729594] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.729887] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.731211] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.731441] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.731605] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.732495] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.732691] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.732843] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be created. [ 773.796670] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.796983] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.796983] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.796983] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.797177] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.816204] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: IN_PROGRESS for 2s [ 773.829254] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26df6822-523e-4c95-9d74-db0cddb065c0 in Status: SUCCESS [ 773.829360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.829698] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.830137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.830223] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.830648] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.830648] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.832719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.832719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.832719] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26df6822-523e-4c95-9d74-db0cddb065c0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.852182] env[65322]: INFO networking_nsxv3.common.synchronization [None req-3c916a97-0b1b-4e55-b18a-3e6db8f2a0e3 tempest-ServersTestJSON-586306987 tempest-ServersTestJSON-586306987-project-member] Enqueued Resource ID: f71805db-9045-455c-ad23-3895d2f4e721 with Priority: HIGHEST for action security_group_rules [ 773.857092] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f71805db-9045-455c-ad23-3895d2f4e721 with Priority: HIGHEST for action security_group_rules [ 773.857760] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f71805db-9045-455c-ad23-3895d2f4e721 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.857885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.857948] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.858232] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.858311] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f71805db-9045-455c-ad23-3895d2f4e721',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.020013] env[65322]: INFO networking_nsxv3.common.synchronization [None req-df9b2b13-532f-45df-925b-5e1ce4e5a907 tempest-ServersTestJSON-586306987 tempest-ServersTestJSON-586306987-project-member] Enqueued Resource ID: f71805db-9045-455c-ad23-3895d2f4e721 with Priority: HIGHEST for action security_group_rules [ 774.021546] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f71805db-9045-455c-ad23-3895d2f4e721 with Priority: HIGHEST for action security_group_rules [ 774.022100] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f71805db-9045-455c-ad23-3895d2f4e721 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.022299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.319963] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: SUCCESS [ 774.319963] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a07e97d-006e-4334-801f-7251980b19f1 deletion is rescheduled due to dependency. [ 774.320130] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.334609] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('26df6822-523e-4c95-9d74-db0cddb065c0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.381070] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.381219] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.381295] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.381560] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.381595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.381902] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f71805db-9045-455c-ad23-3895d2f4e721 already deleted. [ 774.382041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.382166] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.382323] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.382401] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f71805db-9045-455c-ad23-3895d2f4e721',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.837443] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('26df6822-523e-4c95-9d74-db0cddb065c0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.907832] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.907832] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.907832] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.908098] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.908098] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.908098] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f71805db-9045-455c-ad23-3895d2f4e721 already deleted. [ 774.908191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.341305] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.341388] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.341452] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.341684] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.341754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.341847] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26df6822-523e-4c95-9d74-db0cddb065c0 is going to be updated. [ 775.371393] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.371549] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.372739] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.372739] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.372739] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.381573] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26df6822-523e-4c95-9d74-db0cddb065c0 in Status: IN_PROGRESS for 2s [ 775.606419] env[65322]: INFO networking_nsxv3.common.synchronization [req-93dce8c9-36b8-4829-b2ac-6b63bebc138b req-b4275a35-d107-4757-b5e9-5d670c0dad11 tempest-ListServerFiltersTestJSON-548115459 tempest-ListServerFiltersTestJSON-548115459-project-member] Enqueued Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGHEST for action security_group_members [ 775.606419] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGHEST for action security_group_members [ 775.607251] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.607251] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.607251] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.607251] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.607502] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.607502] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.607502] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.607641] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.607719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.607810] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.834146] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: SUCCESS [ 775.834524] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.112867] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.138716] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-867 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.139221] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.139221] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.139396] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.139671] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.139846] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.139959] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.140340] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.141074] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.141323] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 776.141445] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 776.141545] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 776.141644] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 776.141750] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 776.141850] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 776.141975] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 776.162951] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 776.163354] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 776.163354] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 776.163454] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.163855] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-438fd3ee-a445-465c-8fe0-56a39b2060ac taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.164085] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-438fd3ee-a445-465c-8fe0-56a39b2060ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.164216] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-438fd3ee-a445-465c-8fe0-56a39b2060ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.164531] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-438fd3ee-a445-465c-8fe0-56a39b2060ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.164661] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('438fd3ee-a445-465c-8fe0-56a39b2060ac',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.332414] env[65322]: INFO networking_nsxv3.common.synchronization [None req-dba2f7f2-780c-4ee2-8c7a-103205d039bb None None] Enqueued Resource ID: bfd5fe43-72e6-4651-99cc-1127da07d315 with Priority: HIGHEST for action port [ 776.333050] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfd5fe43-72e6-4651-99cc-1127da07d315 with Priority: HIGHEST for action port [ 776.333321] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfd5fe43-72e6-4651-99cc-1127da07d315 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.333517] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfd5fe43-72e6-4651-99cc-1127da07d315" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.333517] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfd5fe43-72e6-4651-99cc-1127da07d315" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.333800] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfd5fe43-72e6-4651-99cc-1127da07d315" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.333913] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfd5fe43-72e6-4651-99cc-1127da07d315',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.408798] env[65322]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] NSXv3 Agent Agent loop - iteration:0 completed [ 776.408964] env[65322]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] NSXv3 Agent Agent loop - iteration:1 started [ 776.612945] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.668256] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.668617] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.668832] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.669252] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.669460] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.669711] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 438fd3ee-a445-465c-8fe0-56a39b2060ac not found, creating... [ 776.670127] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.670303] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.670434] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.670754] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.670948] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.671335] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.671565] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.671726] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.671972] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.672141] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.672327] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 438fd3ee-a445-465c-8fe0-56a39b2060ac is going to be created. [ 776.693485] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.693745] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.693894] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.694231] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.694476] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.694694] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-438fd3ee-a445-465c-8fe0-56a39b2060ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.835879] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bfd5fe43-72e6-4651-99cc-1127da07d315 [ 776.836571] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.836748] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.836824] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.837120] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.837191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.837268] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bfd5fe43-72e6-4651-99cc-1127da07d315 already deleted. [ 776.837353] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfd5fe43-72e6-4651-99cc-1127da07d315" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.115795] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.116129] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.116129] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.116248] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.116337] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.116439] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eae2009-1124-44b2-a496-3582997767b0 is going to be updated. [ 777.153024] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.153024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.153024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.153024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.153024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.164212] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eae2009-1124-44b2-a496-3582997767b0 in Status: IN_PROGRESS for 2s [ 777.396145] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26df6822-523e-4c95-9d74-db0cddb065c0 in Status: SUCCESS [ 777.396145] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.396145] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.396145] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.396434] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.396505] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.396648] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.397099] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.397099] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.397099] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.397099] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('26df6822-523e-4c95-9d74-db0cddb065c0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.436836] env[65322]: INFO networking_nsxv3.common.synchronization [req-93dce8c9-36b8-4829-b2ac-6b63bebc138b req-4eaad3f4-7ccf-4651-b2a5-f630cbe948f6 service nova] Enqueued Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGHEST for action security_group_rules [ 777.442938] env[65322]: INFO networking_nsxv3.common.synchronization [req-93dce8c9-36b8-4829-b2ac-6b63bebc138b req-4eaad3f4-7ccf-4651-b2a5-f630cbe948f6 service nova] Enqueued Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGHEST for action security_group_members [ 777.442938] env[65322]: INFO networking_nsxv3.common.synchronization [req-93dce8c9-36b8-4829-b2ac-6b63bebc138b req-4eaad3f4-7ccf-4651-b2a5-f630cbe948f6 service nova] Enqueued Resource ID: 438fd3ee-a445-465c-8fe0-56a39b2060ac with Priority: HIGHEST for action port [ 777.442938] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGHEST for action security_group_rules [ 777.442938] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGHEST for action security_group_members [ 777.442938] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 438fd3ee-a445-465c-8fe0-56a39b2060ac with Priority: HIGHEST for action port [ 777.442938] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.442938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.442938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.443391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.443391] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.447011] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.447131] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.447473] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-438fd3ee-a445-465c-8fe0-56a39b2060ac taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.447473] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-438fd3ee-a445-465c-8fe0-56a39b2060ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.447614] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-438fd3ee-a445-465c-8fe0-56a39b2060ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.447701] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-438fd3ee-a445-465c-8fe0-56a39b2060ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.447788] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('438fd3ee-a445-465c-8fe0-56a39b2060ac',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.902532] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-26df6822-523e-4c95-9d74-db0cddb065c0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.902873] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.903073] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.904041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.904041] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.904041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.904041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.904041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.904041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.904932] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.905275] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-26df6822-523e-4c95-9d74-db0cddb065c0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.905468] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.905596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.906088] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.906497] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.906590] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.906640] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.906918] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.907152] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.907188] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.907350] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('26df6822-523e-4c95-9d74-db0cddb065c0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.950819] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.950819] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.950982] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 438fd3ee-a445-465c-8fe0-56a39b2060ac with status ACTIVE [ 777.951305] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.951305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.951574] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.951670] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.951764] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.952888] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.952888] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.952888] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.952888] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.952888] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.952888] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.952888] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.952888] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.952888] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.952888] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.953319] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 438fd3ee-a445-465c-8fe0-56a39b2060ac is going to be updated. [ 777.978839] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.979043] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.979043] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.979165] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.979293] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.979450] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-438fd3ee-a445-465c-8fe0-56a39b2060ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.413478] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 26df6822-523e-4c95-9d74-db0cddb065c0: rpc.has_security_group_logging(os_id): False [ 778.432450] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.432726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.432726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.432932] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.465563] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.465563] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.465563] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.465563] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.465563] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.465563] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.465563] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.465563] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.465563] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.465563] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.465563] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.465563] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.465563] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.465563] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.466564] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.466564] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.466564] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26df6822-523e-4c95-9d74-db0cddb065c0 is going to be updated. [ 778.533547] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.533547] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.533547] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.533547] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.533547] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.549982] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26df6822-523e-4c95-9d74-db0cddb065c0 in Status: IN_PROGRESS for 2s [ 778.739811] env[65322]: INFO networking_nsxv3.common.synchronization [None req-4f3251c7-1811-4a60-8431-e79daed27efe tempest-ServerActionsTestJSON-71326710 tempest-ServerActionsTestJSON-71326710-project-member] Enqueued Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_rules [ 778.741615] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_rules [ 778.741890] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.742058] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.742193] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.742444] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.742627] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.833106] env[65322]: INFO networking_nsxv3.common.synchronization [None req-94695e3f-c647-478a-b63f-d5cf129743d8 None None] Enqueued Resource ID: 5fe33460-7998-4837-9a32-76832b70d273 with Priority: HIGHEST for action port [ 778.833909] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fe33460-7998-4837-9a32-76832b70d273 with Priority: HIGHEST for action port [ 778.834311] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fe33460-7998-4837-9a32-76832b70d273 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.834458] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fe33460-7998-4837-9a32-76832b70d273" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.834530] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fe33460-7998-4837-9a32-76832b70d273" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.834764] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fe33460-7998-4837-9a32-76832b70d273" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.834850] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fe33460-7998-4837-9a32-76832b70d273',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.869895] env[65322]: INFO networking_nsxv3.common.synchronization [None req-2cd3af10-4d56-4762-98cc-d34e778e8323 tempest-ServerActionsTestJSON-71326710 tempest-ServerActionsTestJSON-71326710-project-member] Enqueued Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_rules [ 778.870453] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_rules [ 778.870659] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.870734] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.177377] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eae2009-1124-44b2-a496-3582997767b0 in Status: SUCCESS [ 779.177589] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.177817] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.179805] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.180271] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.180271] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.180404] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.180753] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.180753] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.180944] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.273354] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.273354] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.273354] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.273354] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.273354] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.273354] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d already deleted. [ 779.273354] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.273354] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.273354] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.273354] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.338557] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5fe33460-7998-4837-9a32-76832b70d273 [ 779.338557] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.338732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.338732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.338952] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.339485] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.339485] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5fe33460-7998-4837-9a32-76832b70d273 already deleted. [ 779.339485] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fe33460-7998-4837-9a32-76832b70d273" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.683693] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.794852] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.794975] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.795088] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.795315] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.795444] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.795572] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d already deleted. [ 779.795691] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.186413] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.571335] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26df6822-523e-4c95-9d74-db0cddb065c0 in Status: SUCCESS [ 780.571335] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.690417] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.690417] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.690417] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.691111] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.691111] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.691111] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eae2009-1124-44b2-a496-3582997767b0 is going to be updated. [ 780.745226] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.745377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.746034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.746034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.746034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.758845] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eae2009-1124-44b2-a496-3582997767b0 in Status: IN_PROGRESS for 2s [ 782.395333] env[65322]: INFO networking_nsxv3.common.synchronization [req-0ac317d3-a58d-4eb2-ad0a-6ef56d727d7b req-b9db734a-74f4-4a3a-9125-846bc30b8e55 tempest-ServerDiskConfigTestJSON-1167155511 tempest-ServerDiskConfigTestJSON-1167155511-project-member] Enqueued Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 782.395638] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 782.397282] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.397282] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.397282] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.397282] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.397282] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.397282] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.397282] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.397282] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.397282] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.397282] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.773213] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eae2009-1124-44b2-a496-3582997767b0 in Status: SUCCESS [ 782.773378] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.773799] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.773974] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.774056] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.774179] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.774304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.774479] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.774479] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.774579] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.774748] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.903166] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.903166] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.903166] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.903166] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.903166] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.903166] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.903166] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.903166] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.903166] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.903166] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.903166] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 is going to be updated. [ 782.936586] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.936774] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.936833] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.937090] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.937252] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.948593] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: IN_PROGRESS for 2s [ 783.280609] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.280986] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.280986] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.280986] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.281571] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.281571] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.281571] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.281571] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.281571] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.282058] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.282058] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.282058] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.282058] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.282058] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.282235] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.282283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.282317] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.282958] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.282958] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.282958] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.282958] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.539296] env[65322]: INFO networking_nsxv3.common.synchronization [req-3b0066da-077f-49e0-a7ed-b03af28d27f7 req-69711d38-c2c8-431e-9c45-6a209b890df9 tempest-ServersTestBootFromVolume-325336493 tempest-ServersTestBootFromVolume-325336493-project-member] Enqueued Resource ID: 1d03ae1b-566c-4270-87f0-fce3e636d072 with Priority: HIGHEST for action security_group_members [ 783.539848] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d03ae1b-566c-4270-87f0-fce3e636d072 with Priority: HIGHEST for action security_group_members [ 783.540172] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1d03ae1b-566c-4270-87f0-fce3e636d072 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.540294] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.540359] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.540564] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.540719] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.540816] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.540876] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.541335] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.541458] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.541555] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1d03ae1b-566c-4270-87f0-fce3e636d072',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.545753] env[65322]: INFO networking_nsxv3.common.synchronization [req-61db78d6-b14e-4b92-9eb9-750b6205d33d req-700f3d8a-5073-476d-b72f-cd3ae9d00af0 tempest-DeleteServersTestJSON-1463403857 tempest-DeleteServersTestJSON-1463403857-project-member] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 783.546404] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 783.546710] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.546796] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.546838] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.547019] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.547202] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.547260] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.547313] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.547459] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.547543] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.547867] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.786796] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4eae2009-1124-44b2-a496-3582997767b0: rpc.has_security_group_logging(os_id): False [ 783.810037] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.810037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.810037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.810037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.810037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.810037] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.810037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.810037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.810037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.810037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.810037] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.810037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.810037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.810037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.810037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.810774] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.810774] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.810774] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.810774] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.810774] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.810774] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4eae2009-1124-44b2-a496-3582997767b0 is going to be updated. [ 783.883802] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.883802] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.883802] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.883802] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.883802] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.893696] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eae2009-1124-44b2-a496-3582997767b0 in Status: IN_PROGRESS for 2s [ 784.050098] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.050098] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.050098] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.050098] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.050098] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.050098] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.082602] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.082602] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.084651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.084651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.084651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.084651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.084651] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d03ae1b-566c-4270-87f0-fce3e636d072 is going to be updated. [ 784.084651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.085102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.085299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.085848] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.086110] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.086280] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.086618] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.086792] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.086961] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be updated. [ 784.130220] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.130373] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.130486] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.130793] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.130971] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.133314] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.133602] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.133712] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.133919] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.134064] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.145387] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: IN_PROGRESS for 2s [ 784.147026] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d03ae1b-566c-4270-87f0-fce3e636d072 in Status: IN_PROGRESS for 2s [ 784.961113] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: SUCCESS [ 784.961113] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 deletion is rescheduled due to dependency. [ 784.961390] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.273824] env[65322]: INFO networking_nsxv3.common.synchronization [req-0fbaefbf-34a5-4f32-9f0c-f1f8cc7cc659 req-f232b7ae-0b37-42cc-b68e-4f9f87ee577a tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 785.275713] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 785.275922] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.276045] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.276145] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.277243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.277243] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.277243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.277243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.277243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.277243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.277243] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.712772] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-109 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.712772] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-109" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.712772] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-109" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.712772] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-109" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.713093] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.713279] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.713444] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.713766] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.713953] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.714261] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.714469] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 785.716196] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 785.716196] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 785.716196] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.716196] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 785.716196] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 785.739844] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 785.740032] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 785.740172] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 785.740343] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-109" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.741084] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.741084] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.741276] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.741502] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.742368] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.780459] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.910144] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eae2009-1124-44b2-a496-3582997767b0 in Status: SUCCESS [ 785.910372] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.157144] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: SUCCESS [ 786.157474] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 deletion is rescheduled due to dependency. [ 786.157474] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.158184] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1d03ae1b-566c-4270-87f0-fce3e636d072 in Status: SUCCESS [ 786.158330] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1d03ae1b-566c-4270-87f0-fce3e636d072 deletion is rescheduled due to dependency. [ 786.158426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1d03ae1b-566c-4270-87f0-fce3e636d072" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.244511] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.244770] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.244839] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.245185] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.245335] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.245496] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8 not found, creating... [ 786.245841] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.245940] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.246105] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.246252] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.246409] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.246663] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.246821] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.246940] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.247165] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.247318] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.247418] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8 is going to be created. [ 786.272889] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.273520] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.273520] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.273640] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.273854] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.274099] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.282832] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.785523] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.785752] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.787202] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.787202] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.787202] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.787202] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e65996f-05e7-4178-bdb9-30270bc56380 is going to be updated. [ 786.820470] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.820470] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.820470] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.820470] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.820470] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.832030] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: IN_PROGRESS for 2s [ 787.100576] env[65322]: INFO networking_nsxv3.common.synchronization [req-0fbaefbf-34a5-4f32-9f0c-f1f8cc7cc659 req-3efc0505-0e75-4e8b-ae68-306e9e984773 service nova] Enqueued Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_rules [ 787.100815] env[65322]: INFO networking_nsxv3.common.synchronization [req-0fbaefbf-34a5-4f32-9f0c-f1f8cc7cc659 req-3efc0505-0e75-4e8b-ae68-306e9e984773 service nova] Enqueued Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 787.100978] env[65322]: INFO networking_nsxv3.common.synchronization [req-0fbaefbf-34a5-4f32-9f0c-f1f8cc7cc659 req-3efc0505-0e75-4e8b-ae68-306e9e984773 service nova] Enqueued Resource ID: 5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8 with Priority: HIGHEST for action port [ 787.101603] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_rules [ 787.101754] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 787.101880] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8 with Priority: HIGHEST for action port [ 787.103964] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.103964] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.104218] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.104250] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.104391] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.105338] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.105461] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.106379] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.106379] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.106379] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.106379] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.106379] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.494154] env[65322]: INFO networking_nsxv3.common.synchronization [req-80068bd8-b8f7-4589-a8d6-e5c1264c7d60 req-97a7e683-01cb-4406-9f29-5da99f3f499d tempest-ListImageFiltersTestJSON-1830232645 tempest-ListImageFiltersTestJSON-1830232645-project-member] Enqueued Resource ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 with Priority: HIGHEST for action security_group_members [ 787.496972] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 with Priority: HIGHEST for action security_group_members [ 787.496972] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.496972] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.496972] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.496972] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.496972] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.496972] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.497756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.497756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.497834] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.498569] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60b11f04-8768-43f5-bcb0-8bb51ec0bdf2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.612541] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8 with status ACTIVE [ 787.612851] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.612999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.613084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.613299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.613375] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.613560] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.613732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.613732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.613903] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.613983] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.614180] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.614272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.614327] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.614457] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.614521] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.614607] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8 is going to be updated. [ 787.616353] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.616353] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.643134] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.643134] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.643134] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.643134] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.643134] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.643641] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.000099] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60b11f04-8768-43f5-bcb0-8bb51ec0bdf2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.380414] env[65322]: INFO networking_nsxv3.common.synchronization [None req-bf490d51-7884-4947-8218-46ee32ed01e6 tempest-ImagesOneServerNegativeTestJSON-1972759635 tempest-ImagesOneServerNegativeTestJSON-1972759635-project-member] Enqueued Resource ID: 130f56f8-2802-4969-8bce-59e489019959 with Priority: HIGHEST for action security_group_rules [ 788.380700] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 130f56f8-2802-4969-8bce-59e489019959 with Priority: HIGHEST for action security_group_rules [ 788.381462] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-130f56f8-2802-4969-8bce-59e489019959 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.381574] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-130f56f8-2802-4969-8bce-59e489019959" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.381777] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-130f56f8-2802-4969-8bce-59e489019959" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.382010] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-130f56f8-2802-4969-8bce-59e489019959" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.382134] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('130f56f8-2802-4969-8bce-59e489019959',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.503920] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60b11f04-8768-43f5-bcb0-8bb51ec0bdf2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.540439] env[65322]: INFO networking_nsxv3.common.synchronization [None req-4afd6cd7-4f91-4643-ac88-66096ce50ca5 tempest-ImagesOneServerNegativeTestJSON-1972759635 tempest-ImagesOneServerNegativeTestJSON-1972759635-project-member] Enqueued Resource ID: 130f56f8-2802-4969-8bce-59e489019959 with Priority: HIGHEST for action security_group_rules [ 788.540993] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 130f56f8-2802-4969-8bce-59e489019959 with Priority: HIGHEST for action security_group_rules [ 788.541665] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-130f56f8-2802-4969-8bce-59e489019959 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.541818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-130f56f8-2802-4969-8bce-59e489019959" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.851611] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: SUCCESS [ 788.851611] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.851611] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.852042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.852406] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.852531] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.852704] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.852904] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.853172] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.853285] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.905773] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.905985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.905985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.906245] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.906337] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.906440] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 130f56f8-2802-4969-8bce-59e489019959 already deleted. [ 788.906524] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-130f56f8-2802-4969-8bce-59e489019959" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.906684] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-130f56f8-2802-4969-8bce-59e489019959" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.906854] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-130f56f8-2802-4969-8bce-59e489019959" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.906932] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('130f56f8-2802-4969-8bce-59e489019959',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.006639] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.006988] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.006988] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.007554] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.007812] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.007950] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 is going to be updated. [ 789.048045] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.048045] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.048293] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.048332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.048450] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.060112] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 in Status: IN_PROGRESS for 2s [ 789.358475] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.438939] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.439155] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.439155] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.439667] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.439754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.442022] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 130f56f8-2802-4969-8bce-59e489019959 already deleted. [ 789.442022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-130f56f8-2802-4969-8bce-59e489019959" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.863269] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.868022] env[65322]: INFO networking_nsxv3.common.synchronization [None req-ef5833f8-ac79-4130-a6df-42963fea2b31 None None] Enqueued Resource ID: 37013e27-a949-4f70-93a1-9183d1c92b79 with Priority: HIGHEST for action port [ 789.868659] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37013e27-a949-4f70-93a1-9183d1c92b79 with Priority: HIGHEST for action port [ 789.868950] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-37013e27-a949-4f70-93a1-9183d1c92b79 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.869302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37013e27-a949-4f70-93a1-9183d1c92b79" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.869395] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37013e27-a949-4f70-93a1-9183d1c92b79" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.869927] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37013e27-a949-4f70-93a1-9183d1c92b79" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.869927] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37013e27-a949-4f70-93a1-9183d1c92b79',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.367506] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.367716] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.367792] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.368017] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.368124] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.368270] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e65996f-05e7-4178-bdb9-30270bc56380 is going to be updated. [ 790.372939] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 37013e27-a949-4f70-93a1-9183d1c92b79 [ 790.372939] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.373119] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.373119] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.373273] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.373370] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.373498] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:37013e27-a949-4f70-93a1-9183d1c92b79 already deleted. [ 790.373617] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37013e27-a949-4f70-93a1-9183d1c92b79" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.407488] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.407488] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.407488] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.408390] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.408390] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.419882] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: IN_PROGRESS for 2s [ 791.072096] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 in Status: SUCCESS [ 791.072393] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.285537] env[65322]: INFO networking_nsxv3.common.synchronization [None req-9ded624c-b45a-4d67-b69b-56ebd53027f1 None None] Enqueued Resource ID: 6eea5a70-6bd2-4b4d-bbe8-bde4dee3c401 with Priority: HIGHEST for action port [ 792.286284] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eea5a70-6bd2-4b4d-bbe8-bde4dee3c401 with Priority: HIGHEST for action port [ 792.286555] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-6eea5a70-6bd2-4b4d-bbe8-bde4dee3c401 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.286744] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6eea5a70-6bd2-4b4d-bbe8-bde4dee3c401" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.286832] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6eea5a70-6bd2-4b4d-bbe8-bde4dee3c401" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.292271] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6eea5a70-6bd2-4b4d-bbe8-bde4dee3c401" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.292271] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6eea5a70-6bd2-4b4d-bbe8-bde4dee3c401',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.430551] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: SUCCESS [ 792.431104] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.431416] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.433018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.433018] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.433018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.433018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.433018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.433018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.433018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.433018] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.795152] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6eea5a70-6bd2-4b4d-bbe8-bde4dee3c401 [ 792.795464] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.795655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.795732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.796304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.796442] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.796581] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6eea5a70-6bd2-4b4d-bbe8-bde4dee3c401 already deleted. [ 792.796674] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6eea5a70-6bd2-4b4d-bbe8-bde4dee3c401" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.935992] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.936233] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.936233] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.936562] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.936624] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.936719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.936777] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.936891] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.936980] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.937082] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.937304] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.937304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.937457] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.937501] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.937628] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.937717] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.937765] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.937899] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.937965] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.938060] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.938174] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.441181] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e65996f-05e7-4178-bdb9-30270bc56380: rpc.has_security_group_logging(os_id): False [ 793.462139] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.462315] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.462701] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.462701] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.505071] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.505254] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.505390] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.505454] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.505666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.505745] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.505946] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.506069] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.506128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.506269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.506339] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.506522] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.506609] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.507320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.507320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.507320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.507320] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e65996f-05e7-4178-bdb9-30270bc56380 is going to be updated. [ 793.573257] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.574186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.574186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.574305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.575032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.598839] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: IN_PROGRESS for 2s [ 795.627987] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: SUCCESS [ 795.628366] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.562454] env[65322]: INFO networking_nsxv3.common.synchronization [req-59b95bf8-ae43-43ec-8931-7838c1737676 req-11178204-96d8-475f-a266-a7c84e631723 tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 796.562694] env[65322]: INFO networking_nsxv3.common.synchronization [req-59b95bf8-ae43-43ec-8931-7838c1737676 req-11178204-96d8-475f-a266-a7c84e631723 tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 with Priority: HIGHEST for action security_group_members [ 796.563323] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 796.563418] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 with Priority: HIGHEST for action security_group_members [ 796.563718] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.563840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.563898] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.564105] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.564250] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.564401] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.564454] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.564604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.565338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.565338] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.566015] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-df60b3b7-a928-4d44-8a9e-0fb83f522e16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.566965] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.566965] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.566965] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.566965] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.566965] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.566965] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.566965] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.566965] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.566965] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df60b3b7-a928-4d44-8a9e-0fb83f522e16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.615317] env[65322]: INFO networking_nsxv3.common.synchronization [req-59b95bf8-ae43-43ec-8931-7838c1737676 req-11178204-96d8-475f-a266-a7c84e631723 tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_rules [ 796.615491] env[65322]: INFO networking_nsxv3.common.synchronization [req-59b95bf8-ae43-43ec-8931-7838c1737676 req-11178204-96d8-475f-a266-a7c84e631723 tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 796.615617] env[65322]: INFO networking_nsxv3.common.synchronization [req-59b95bf8-ae43-43ec-8931-7838c1737676 req-11178204-96d8-475f-a266-a7c84e631723 tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 with Priority: HIGHEST for action security_group_rules [ 796.615737] env[65322]: INFO networking_nsxv3.common.synchronization [req-59b95bf8-ae43-43ec-8931-7838c1737676 req-11178204-96d8-475f-a266-a7c84e631723 tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 with Priority: HIGHEST for action security_group_members [ 796.616335] env[65322]: INFO networking_nsxv3.common.synchronization [req-59b95bf8-ae43-43ec-8931-7838c1737676 req-11178204-96d8-475f-a266-a7c84e631723 tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8 with Priority: HIGHEST for action port [ 796.616335] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_rules [ 796.616535] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 with Priority: HIGHEST for action security_group_rules [ 796.616570] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8 with Priority: HIGHEST for action port [ 796.616655] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 796.616739] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 with Priority: HIGHEST for action security_group_members [ 796.617017] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.617305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.617381] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.617576] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.617653] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.618957] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df60b3b7-a928-4d44-8a9e-0fb83f522e16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.619441] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.619441] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.619543] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.619543] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df60b3b7-a928-4d44-8a9e-0fb83f522e16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.621560] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.621669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.621776] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.621949] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.622134] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.626259] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.626259] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.626259] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-df60b3b7-a928-4d44-8a9e-0fb83f522e16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.626259] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.069632] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.070176] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df60b3b7-a928-4d44-8a9e-0fb83f522e16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.119817] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.119986] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.122622] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-df60b3b7-a928-4d44-8a9e-0fb83f522e16 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.122622] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.127456] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8 with status ACTIVE [ 797.127456] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.127456] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.127456] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.127684] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.127684] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.127956] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.128149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.128259] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.128541] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.128661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.128883] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.129015] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.129108] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.129278] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.129375] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.129482] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8 is going to be updated. [ 797.151336] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.151525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.151572] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.151763] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.151905] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.152084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.572065] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.573582] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df60b3b7-a928-4d44-8a9e-0fb83f522e16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.078081] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.078081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.078081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.078532] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.078532] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.078532] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 is going to be created. [ 798.079777] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.079971] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.079971] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.080148] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.080255] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.080349] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e65996f-05e7-4178-bdb9-30270bc56380 is going to be updated. [ 798.105937] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.105937] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.105937] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.106191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.106396] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.108620] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.108686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.108761] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.108917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.109052] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.116994] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 in Status: UNINITIALIZED for 2s [ 798.117655] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: IN_PROGRESS for 2s [ 799.576565] env[65322]: INFO networking_nsxv3.common.synchronization [req-ef661ffa-240c-4311-87c2-d69364f29c0b req-35b3c44e-add7-49c1-9a42-f31e2876ed62 tempest-ServerActionsV293TestJSON-768711526 tempest-ServerActionsV293TestJSON-768711526-project-member] Enqueued Resource ID: aa7cb676-7b51-4e93-980a-5540e7a7e88b with Priority: HIGHEST for action security_group_members [ 799.577142] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7cb676-7b51-4e93-980a-5540e7a7e88b with Priority: HIGHEST for action security_group_members [ 799.577452] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7cb676-7b51-4e93-980a-5540e7a7e88b taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.577577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.577645] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.577846] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.578015] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.578109] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.578166] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.578317] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.578401] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.578494] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa7cb676-7b51-4e93-980a-5540e7a7e88b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.081690] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.081927] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.082014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.082281] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.107361] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.107577] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.107692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.107742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.107929] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.108024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.108159] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa7cb676-7b51-4e93-980a-5540e7a7e88b is going to be updated. [ 800.129297] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 in Status: SUCCESS [ 800.129586] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.129751] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.130058] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.130303] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.130460] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.131051] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.131051] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.131051] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.131051] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df60b3b7-a928-4d44-8a9e-0fb83f522e16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.139191] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: SUCCESS [ 800.139536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.139699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.139979] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.140185] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.140312] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.140377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.140587] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.140666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.140789] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.142823] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.142944] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.143538] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.143538] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.143538] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.153444] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7cb676-7b51-4e93-980a-5540e7a7e88b in Status: IN_PROGRESS for 2s [ 800.634937] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df60b3b7-a928-4d44-8a9e-0fb83f522e16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.646087] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.138466] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df60b3b7-a928-4d44-8a9e-0fb83f522e16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.148359] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.645299] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.645299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.645299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.645299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.645299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.645299] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 is going to be updated. [ 801.650224] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.650380] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.650454] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.654193] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.655449] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.655449] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e65996f-05e7-4178-bdb9-30270bc56380 is going to be updated. [ 801.679968] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.679968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.679968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.680188] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.680267] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.682828] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.683634] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.683634] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.683634] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.683634] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.696258] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 in Status: IN_PROGRESS for 2s [ 801.697263] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: IN_PROGRESS for 2s [ 801.786962] env[65322]: INFO networking_nsxv3.common.synchronization [req-11d1b67e-e358-4bff-bf85-d8832a964c4a req-f51ad624-0284-49e9-9ddd-4aafcd475480 tempest-ServersAdminTestJSON-1989503110 tempest-ServersAdminTestJSON-1989503110-project-member] Enqueued Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_members [ 801.787632] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_members [ 801.787952] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.788078] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.788149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.788422] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.788582] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.788789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.788789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.788916] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.789027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.789156] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.164333] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7cb676-7b51-4e93-980a-5540e7a7e88b in Status: SUCCESS [ 802.165517] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa7cb676-7b51-4e93-980a-5540e7a7e88b deletion is rescheduled due to dependency. [ 802.165517] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7cb676-7b51-4e93-980a-5540e7a7e88b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.207134] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-174 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.207649] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-174" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.207649] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-174" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.207926] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-174" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.208628] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.208793] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.208902] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.209174] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.209402] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.209663] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.209782] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 802.209885] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 802.209985] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 802.210112] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.210304] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 802.210435] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 802.241450] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 802.241450] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 802.241665] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 802.243455] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-174" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.243455] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-20bdf697-1554-48e0-826c-3f92d6c506c7 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.243455] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-20bdf697-1554-48e0-826c-3f92d6c506c7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.243455] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-20bdf697-1554-48e0-826c-3f92d6c506c7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.243455] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-20bdf697-1554-48e0-826c-3f92d6c506c7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.243455] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20bdf697-1554-48e0-826c-3f92d6c506c7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.291489] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.292294] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.292391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.292612] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.292707] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.294053] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.294053] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.294053] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.294053] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.294053] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.294053] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 already deleted. [ 802.294053] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.746376] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.746731] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.746731] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.747014] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.747223] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.747400] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 20bdf697-1554-48e0-826c-3f92d6c506c7 not found, creating... [ 802.747655] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.747825] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.747949] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.748256] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.748400] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.748697] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.748860] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.748992] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.749235] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.749398] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.749531] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 20bdf697-1554-48e0-826c-3f92d6c506c7 is going to be created. [ 802.771419] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.771663] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.771764] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.772051] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.772290] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.772518] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-20bdf697-1554-48e0-826c-3f92d6c506c7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.526530] env[65322]: INFO networking_nsxv3.common.synchronization [req-11d1b67e-e358-4bff-bf85-d8832a964c4a req-4cbabd55-4425-4d32-bad7-57796e8ee130 service nova] Enqueued Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_rules [ 803.526707] env[65322]: INFO networking_nsxv3.common.synchronization [req-11d1b67e-e358-4bff-bf85-d8832a964c4a req-4cbabd55-4425-4d32-bad7-57796e8ee130 service nova] Enqueued Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_members [ 803.526887] env[65322]: INFO networking_nsxv3.common.synchronization [req-11d1b67e-e358-4bff-bf85-d8832a964c4a req-4cbabd55-4425-4d32-bad7-57796e8ee130 service nova] Enqueued Resource ID: 20bdf697-1554-48e0-826c-3f92d6c506c7 with Priority: HIGHEST for action port [ 803.527627] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_rules [ 803.527781] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_members [ 803.527840] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20bdf697-1554-48e0-826c-3f92d6c506c7 with Priority: HIGHEST for action port [ 803.530910] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.530910] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.530910] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.530910] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.531147] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.531991] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.532542] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.532620] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.532841] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.533052] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.533205] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.533304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.533534] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.533628] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.533902] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.538162] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-20bdf697-1554-48e0-826c-3f92d6c506c7 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.538336] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20bdf697-1554-48e0-826c-3f92d6c506c7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.538383] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20bdf697-1554-48e0-826c-3f92d6c506c7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.538759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20bdf697-1554-48e0-826c-3f92d6c506c7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.538857] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20bdf697-1554-48e0-826c-3f92d6c506c7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.709310] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 in Status: SUCCESS [ 803.709567] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.709744] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.709980] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.710185] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.710303] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.710371] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.710522] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.710596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.710800] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.710900] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df60b3b7-a928-4d44-8a9e-0fb83f522e16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.712648] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: SUCCESS [ 803.712874] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.713048] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.713222] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.713388] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.713493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.714944] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.715172] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.715172] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.715290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.715290] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.832201] env[65322]: INFO networking_nsxv3.common.synchronization [req-f1e66bfa-79aa-4385-bc37-488bd5b07438 req-bb4a5eed-ca7a-401a-a098-af099de197ed tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: bd87a172-9e18-4eb7-aeaf-9dfe8525167b with Priority: HIGHEST for action security_group_members [ 803.832450] env[65322]: INFO networking_nsxv3.common.synchronization [req-f1e66bfa-79aa-4385-bc37-488bd5b07438 req-bb4a5eed-ca7a-401a-a098-af099de197ed tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 with Priority: HIGHEST for action security_group_members [ 803.832533] env[65322]: INFO networking_nsxv3.common.synchronization [req-f1e66bfa-79aa-4385-bc37-488bd5b07438 req-bb4a5eed-ca7a-401a-a098-af099de197ed tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 803.833192] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd87a172-9e18-4eb7-aeaf-9dfe8525167b with Priority: HIGHEST for action security_group_members [ 803.833304] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 with Priority: HIGHEST for action security_group_members [ 803.833391] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 803.833670] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd87a172-9e18-4eb7-aeaf-9dfe8525167b taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.833817] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd87a172-9e18-4eb7-aeaf-9dfe8525167b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.833919] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd87a172-9e18-4eb7-aeaf-9dfe8525167b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.834358] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd87a172-9e18-4eb7-aeaf-9dfe8525167b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.834493] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.834667] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.834667] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.835161] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.835161] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.835161] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd87a172-9e18-4eb7-aeaf-9dfe8525167b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.835814] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-df60b3b7-a928-4d44-8a9e-0fb83f522e16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.835920] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.835988] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.836151] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.836307] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.836422] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.836485] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.836625] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.836707] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.836798] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df60b3b7-a928-4d44-8a9e-0fb83f522e16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.837557] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.837656] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.837719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.837862] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.837998] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.838102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.838165] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.838321] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.838393] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.838482] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.886577] env[65322]: INFO networking_nsxv3.common.synchronization [req-f1e66bfa-79aa-4385-bc37-488bd5b07438 req-bb4a5eed-ca7a-401a-a098-af099de197ed tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_rules [ 803.886750] env[65322]: INFO networking_nsxv3.common.synchronization [req-f1e66bfa-79aa-4385-bc37-488bd5b07438 req-bb4a5eed-ca7a-401a-a098-af099de197ed tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 803.886880] env[65322]: INFO networking_nsxv3.common.synchronization [req-f1e66bfa-79aa-4385-bc37-488bd5b07438 req-bb4a5eed-ca7a-401a-a098-af099de197ed tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: bd87a172-9e18-4eb7-aeaf-9dfe8525167b with Priority: HIGHEST for action security_group_rules [ 803.887027] env[65322]: INFO networking_nsxv3.common.synchronization [req-f1e66bfa-79aa-4385-bc37-488bd5b07438 req-bb4a5eed-ca7a-401a-a098-af099de197ed tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: bd87a172-9e18-4eb7-aeaf-9dfe8525167b with Priority: HIGHEST for action security_group_members [ 803.887163] env[65322]: INFO networking_nsxv3.common.synchronization [req-f1e66bfa-79aa-4385-bc37-488bd5b07438 req-bb4a5eed-ca7a-401a-a098-af099de197ed tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 with Priority: HIGHEST for action security_group_rules [ 803.887271] env[65322]: INFO networking_nsxv3.common.synchronization [req-f1e66bfa-79aa-4385-bc37-488bd5b07438 req-bb4a5eed-ca7a-401a-a098-af099de197ed tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 with Priority: HIGHEST for action security_group_members [ 803.887388] env[65322]: INFO networking_nsxv3.common.synchronization [req-f1e66bfa-79aa-4385-bc37-488bd5b07438 req-bb4a5eed-ca7a-401a-a098-af099de197ed tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8 with Priority: HIGHEST for action port [ 803.887960] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_rules [ 803.888515] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd87a172-9e18-4eb7-aeaf-9dfe8525167b with Priority: HIGHEST for action security_group_rules [ 803.888515] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 with Priority: HIGHEST for action security_group_members [ 803.888515] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8 with Priority: HIGHEST for action port [ 803.888515] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 with Priority: HIGHEST for action security_group_rules [ 803.888515] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 803.888889] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd87a172-9e18-4eb7-aeaf-9dfe8525167b with Priority: HIGHEST for action security_group_members [ 803.889203] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.889316] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.889482] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd87a172-9e18-4eb7-aeaf-9dfe8525167b taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.889582] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd87a172-9e18-4eb7-aeaf-9dfe8525167b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.889644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd87a172-9e18-4eb7-aeaf-9dfe8525167b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.889898] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd87a172-9e18-4eb7-aeaf-9dfe8525167b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.889987] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd87a172-9e18-4eb7-aeaf-9dfe8525167b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.890926] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-df60b3b7-a928-4d44-8a9e-0fb83f522e16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.891034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.891237] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.891338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.891403] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.891596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.891685] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.892433] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df60b3b7-a928-4d44-8a9e-0fb83f522e16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.892524] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.892711] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.892851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.893061] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd87a172-9e18-4eb7-aeaf-9dfe8525167b taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.893138] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd87a172-9e18-4eb7-aeaf-9dfe8525167b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.041421] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.041578] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.042229] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.042919] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 20bdf697-1554-48e0-826c-3f92d6c506c7 with status ACTIVE [ 804.043079] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.043240] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.043460] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.043577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.043762] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.043863] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.044058] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.044133] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.044302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.044376] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.044812] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.044812] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.044812] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.045188] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.045188] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.045188] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 20bdf697-1554-48e0-826c-3f92d6c506c7 is going to be updated. [ 804.074981] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.075287] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.075340] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.075592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.075748] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.075930] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20bdf697-1554-48e0-826c-3f92d6c506c7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.217177] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df60b3b7-a928-4d44-8a9e-0fb83f522e16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.218592] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.218807] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.339924] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df60b3b7-a928-4d44-8a9e-0fb83f522e16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.341380] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bd87a172-9e18-4eb7-aeaf-9dfe8525167b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.344606] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.395395] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd87a172-9e18-4eb7-aeaf-9dfe8525167b taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.395704] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd87a172-9e18-4eb7-aeaf-9dfe8525167b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.395704] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8 with status ACTIVE [ 804.395895] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.396036] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.396109] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.396318] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.396404] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.396582] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.396676] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.396741] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.396890] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.396956] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.397295] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.397410] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.397464] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.397604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.397681] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.397766] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8 is going to be updated. [ 804.421484] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.421683] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.421792] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.421982] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.422166] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.422390] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b73dd95-ebf7-4d1d-a9d4-b92ec4b323a8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.500680] env[65322]: INFO networking_nsxv3.common.synchronization [req-407ffba1-0b2f-4fe3-bb99-c88c66dd2432 req-b68c2098-8642-4f87-8316-4e1820b5e99c tempest-ServersAdminTestJSON-1989503110 tempest-ServersAdminTestJSON-1989503110-project-member] Enqueued Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_members [ 804.501408] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_members [ 804.501567] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.501667] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.550536] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.723298] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df60b3b7-a928-4d44-8a9e-0fb83f522e16: rpc.has_security_group_logging(os_id): False [ 804.747258] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.748811] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.748811] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.748811] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.748811] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.748811] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.748811] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.748811] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.749368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.749368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.749368] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 is going to be created. [ 804.813190] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.813334] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.813402] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.813613] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.813793] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.829772] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 in Status: IN_PROGRESS for 2s [ 804.847814] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df60b3b7-a928-4d44-8a9e-0fb83f522e16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.847814] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bd87a172-9e18-4eb7-aeaf-9dfe8525167b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.847814] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.858197] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-174 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.858197] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-174" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.858197] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-174" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.858197] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-174" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.858197] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.858197] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.858197] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.858867] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.859195] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.859609] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 804.859857] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 804.860296] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 804.860577] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 804.860933] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 804.861211] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 804.861519] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 804.889027] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 804.889027] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 804.889027] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 804.889027] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-174" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.889027] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-2d3203b5-6e6e-4826-9f24-6f4ba4189fa5 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.889027] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-2d3203b5-6e6e-4826-9f24-6f4ba4189fa5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.892169] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-2d3203b5-6e6e-4826-9f24-6f4ba4189fa5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.892850] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-2d3203b5-6e6e-4826-9f24-6f4ba4189fa5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.893096] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d3203b5-6e6e-4826-9f24-6f4ba4189fa5',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.054244] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.054424] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.055455] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.055563] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.055598] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.055732] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 is going to be created. [ 805.083168] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.083596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.083762] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.084134] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.085206] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.100090] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: UNINITIALIZED for 2s [ 805.350281] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.350446] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.350507] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.350746] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.350844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.350946] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd87a172-9e18-4eb7-aeaf-9dfe8525167b is going to be created. [ 805.352310] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.352432] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.352544] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.352763] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.352888] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.353031] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 is going to be updated. [ 805.354228] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.354393] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.354490] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.354700] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.354829] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.354975] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e65996f-05e7-4178-bdb9-30270bc56380 is going to be updated. [ 805.384355] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.384522] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.384592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.384819] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.384983] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.390996] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.391194] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.391396] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.391679] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.391914] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.394119] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.394314] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.394428] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.394745] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.394876] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.396548] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.397441] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.397441] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.397441] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.397441] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.397441] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 2d3203b5-6e6e-4826-9f24-6f4ba4189fa5 not found, creating... [ 805.397898] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.398013] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.398187] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.398507] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.398693] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.399036] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.399268] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.399426] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.399673] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.399852] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.400035] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 2d3203b5-6e6e-4826-9f24-6f4ba4189fa5 is going to be created. [ 805.402686] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd87a172-9e18-4eb7-aeaf-9dfe8525167b in Status: UNINITIALIZED for 2s [ 805.403444] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: IN_PROGRESS for 2s [ 805.410364] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 in Status: IN_PROGRESS for 2s [ 805.416258] env[65322]: INFO networking_nsxv3.common.synchronization [None req-45ab8373-f4ad-492c-9837-9cb6545354a0 None None] Enqueued Resource ID: 86c89c11-7f64-4eb7-9762-2139229c2ca6 with Priority: HIGHEST for action port [ 805.416258] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86c89c11-7f64-4eb7-9762-2139229c2ca6 with Priority: HIGHEST for action port [ 805.416878] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-86c89c11-7f64-4eb7-9762-2139229c2ca6 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.417016] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86c89c11-7f64-4eb7-9762-2139229c2ca6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.417823] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86c89c11-7f64-4eb7-9762-2139229c2ca6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.418024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86c89c11-7f64-4eb7-9762-2139229c2ca6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.418706] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86c89c11-7f64-4eb7-9762-2139229c2ca6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.434867] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.435155] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.435276] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.437331] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.437331] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.437331] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-2d3203b5-6e6e-4826-9f24-6f4ba4189fa5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.926937] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 86c89c11-7f64-4eb7-9762-2139229c2ca6 [ 805.927433] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.927433] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.927433] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.927605] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.927676] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.927769] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:86c89c11-7f64-4eb7-9762-2139229c2ca6 already deleted. [ 805.927848] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86c89c11-7f64-4eb7-9762-2139229c2ca6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.213156] env[65322]: INFO networking_nsxv3.common.synchronization [req-407ffba1-0b2f-4fe3-bb99-c88c66dd2432 req-65725d45-c80d-4cdd-a1b6-3a5dca4d66bd service nova] Enqueued Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_rules [ 806.213156] env[65322]: INFO networking_nsxv3.common.synchronization [req-407ffba1-0b2f-4fe3-bb99-c88c66dd2432 req-65725d45-c80d-4cdd-a1b6-3a5dca4d66bd service nova] Enqueued Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_members [ 806.213156] env[65322]: INFO networking_nsxv3.common.synchronization [req-407ffba1-0b2f-4fe3-bb99-c88c66dd2432 req-65725d45-c80d-4cdd-a1b6-3a5dca4d66bd service nova] Enqueued Resource ID: 2d3203b5-6e6e-4826-9f24-6f4ba4189fa5 with Priority: HIGHEST for action port [ 806.213156] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_rules [ 806.213156] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_members [ 806.213156] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d3203b5-6e6e-4826-9f24-6f4ba4189fa5 with Priority: HIGHEST for action port [ 806.213156] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.213156] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.213551] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.213551] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.213551] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d3203b5-6e6e-4826-9f24-6f4ba4189fa5 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.213712] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d3203b5-6e6e-4826-9f24-6f4ba4189fa5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.213820] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d3203b5-6e6e-4826-9f24-6f4ba4189fa5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.215059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d3203b5-6e6e-4826-9f24-6f4ba4189fa5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.215059] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d3203b5-6e6e-4826-9f24-6f4ba4189fa5',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.717725] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d3203b5-6e6e-4826-9f24-6f4ba4189fa5 with status ACTIVE [ 806.717725] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.717970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.717970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.718362] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.718362] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.718483] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.722022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.722022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.722022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.722022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.722022] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.722022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.722022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.722022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.722022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.722022] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d3203b5-6e6e-4826-9f24-6f4ba4189fa5 is going to be updated. [ 806.743978] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.743978] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.743978] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.743978] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.743978] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.744325] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d3203b5-6e6e-4826-9f24-6f4ba4189fa5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.862456] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 in Status: SUCCESS [ 806.862456] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.862666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.864333] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.864333] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df60b3b7-a928-4d44-8a9e-0fb83f522e16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.112609] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: SUCCESS [ 807.112922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.113420] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.113658] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.113833] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.113968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.114052] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.114231] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.114312] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.114403] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.114506] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.115444] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.115544] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.115729] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.115829] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.115895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.116056] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.116131] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.116218] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.366152] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-df60b3b7-a928-4d44-8a9e-0fb83f522e16 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.366356] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.417566] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd87a172-9e18-4eb7-aeaf-9dfe8525167b in Status: SUCCESS [ 807.417783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd87a172-9e18-4eb7-aeaf-9dfe8525167b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.417946] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd87a172-9e18-4eb7-aeaf-9dfe8525167b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.418368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd87a172-9e18-4eb7-aeaf-9dfe8525167b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.418368] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.418511] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.418545] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.418725] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.418973] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.418973] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd87a172-9e18-4eb7-aeaf-9dfe8525167b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.420795] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 in Status: SUCCESS [ 807.421066] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.421821] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: SUCCESS [ 807.421989] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.422152] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.422335] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.423243] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.423243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.423243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.423243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.423243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.423243] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df60b3b7-a928-4d44-8a9e-0fb83f522e16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.424399] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.424399] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.424399] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.424399] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.424551] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.425309] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.425309] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.425309] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.618162] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.619035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.619035] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.927189] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bd87a172-9e18-4eb7-aeaf-9dfe8525167b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.927976] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df60b3b7-a928-4d44-8a9e-0fb83f522e16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.928734] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.110432] env[65322]: INFO networking_nsxv3.common.synchronization [None req-1d883b2c-bd46-418c-bf2a-3ef7dc8bedcc None None] Enqueued Resource ID: dc9e2f5d-b36a-4ba4-8d14-b0848af1bba3 with Priority: HIGHEST for action port [ 808.111381] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc9e2f5d-b36a-4ba4-8d14-b0848af1bba3 with Priority: HIGHEST for action port [ 808.111595] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc9e2f5d-b36a-4ba4-8d14-b0848af1bba3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.112183] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc9e2f5d-b36a-4ba4-8d14-b0848af1bba3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.112286] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc9e2f5d-b36a-4ba4-8d14-b0848af1bba3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.112646] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc9e2f5d-b36a-4ba4-8d14-b0848af1bba3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.112994] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc9e2f5d-b36a-4ba4-8d14-b0848af1bba3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.123534] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.430120] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bd87a172-9e18-4eb7-aeaf-9dfe8525167b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.432460] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df60b3b7-a928-4d44-8a9e-0fb83f522e16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.433283] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.616059] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc9e2f5d-b36a-4ba4-8d14-b0848af1bba3 [ 808.616179] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.616961] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.616961] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.616961] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.616961] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.616961] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc9e2f5d-b36a-4ba4-8d14-b0848af1bba3 already deleted. [ 808.616961] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc9e2f5d-b36a-4ba4-8d14-b0848af1bba3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.628417] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.628582] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.628650] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.628868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.628952] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.629054] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 is going to be updated. [ 808.665561] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.665761] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.665897] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.666147] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.666267] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.678139] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: IN_PROGRESS for 2s [ 808.932911] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.932911] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.933098] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.933746] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.933746] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.933746] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd87a172-9e18-4eb7-aeaf-9dfe8525167b is going to be updated. [ 808.939853] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.940092] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.940244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.940471] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.940616] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.940734] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 is going to be updated. [ 808.942205] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.942277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.942368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.942553] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.942644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.942827] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e65996f-05e7-4178-bdb9-30270bc56380 is going to be updated. [ 808.973557] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.973752] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.973821] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.974079] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.974223] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.976035] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.976160] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.976228] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.976417] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.976551] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.978600] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.978696] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.978805] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.978963] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.979089] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.998925] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd87a172-9e18-4eb7-aeaf-9dfe8525167b in Status: IN_PROGRESS for 2s [ 808.998925] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 in Status: IN_PROGRESS for 2s [ 809.000243] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: IN_PROGRESS for 2s [ 809.313313] env[65322]: INFO networking_nsxv3.common.synchronization [req-98f5ee41-f476-4fa7-9131-931fd960ae87 req-91d40139-c9c0-4fa9-a2ac-d94af2795859 tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: bd87a172-9e18-4eb7-aeaf-9dfe8525167b with Priority: HIGHEST for action security_group_members [ 809.313685] env[65322]: INFO networking_nsxv3.common.synchronization [req-98f5ee41-f476-4fa7-9131-931fd960ae87 req-91d40139-c9c0-4fa9-a2ac-d94af2795859 tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 809.313685] env[65322]: INFO networking_nsxv3.common.synchronization [req-98f5ee41-f476-4fa7-9131-931fd960ae87 req-91d40139-c9c0-4fa9-a2ac-d94af2795859 tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 with Priority: HIGHEST for action security_group_members [ 809.314402] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd87a172-9e18-4eb7-aeaf-9dfe8525167b with Priority: HIGHEST for action security_group_members [ 809.314624] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 809.314769] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 with Priority: HIGHEST for action security_group_members [ 809.315138] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-bd87a172-9e18-4eb7-aeaf-9dfe8525167b taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.315330] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bd87a172-9e18-4eb7-aeaf-9dfe8525167b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.315624] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.315757] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.316067] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-df60b3b7-a928-4d44-8a9e-0fb83f522e16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.316168] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.697255] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: SUCCESS [ 810.697579] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.697925] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.697925] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.698141] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.698221] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.698273] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.699198] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.699198] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.699198] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.013302] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bd87a172-9e18-4eb7-aeaf-9dfe8525167b in Status: SUCCESS [ 811.013559] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd87a172-9e18-4eb7-aeaf-9dfe8525167b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.014541] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: SUCCESS [ 811.014742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.014935] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd87a172-9e18-4eb7-aeaf-9dfe8525167b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.015234] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd87a172-9e18-4eb7-aeaf-9dfe8525167b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.015528] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.015642] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.015803] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.016055] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.016181] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.016181] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd87a172-9e18-4eb7-aeaf-9dfe8525167b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.016347] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bd87a172-9e18-4eb7-aeaf-9dfe8525167b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.017583] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.017776] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.017965] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.018098] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.018149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.018349] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.018411] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.018500] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.018685] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.018769] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.018829] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.018973] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.019126] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.019220] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.019293] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.019480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.019584] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.019694] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.019892] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.024323] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 in Status: SUCCESS [ 811.025020] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.025165] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bd87a172-9e18-4eb7-aeaf-9dfe8525167b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.025810] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bd87a172-9e18-4eb7-aeaf-9dfe8525167b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.025810] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.026082] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.026082] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.026895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.026895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.026895] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bd87a172-9e18-4eb7-aeaf-9dfe8525167b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.027768] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.027874] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.028167] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.028644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.028644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.028800] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.028800] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.028895] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.029862] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.029983] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.030132] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.030358] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.030358] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.030565] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.030788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.030873] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.030929] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df60b3b7-a928-4d44-8a9e-0fb83f522e16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.033339] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e65996f-05e7-4178-bdb9-30270bc56380: rpc.has_security_group_logging(os_id): False [ 811.035119] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.035119] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.035271] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.035668] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.035668] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.035668] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.035668] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.035787] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df60b3b7-a928-4d44-8a9e-0fb83f522e16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.060541] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.061614] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.061614] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.061614] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.061894] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.061955] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.062093] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.062154] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.062313] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.062452] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.062740] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.062941] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.063042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.063442] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.063571] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.063987] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.064276] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.064394] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.064720] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.064837] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.064919] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e65996f-05e7-4178-bdb9-30270bc56380 is going to be updated. [ 811.137646] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.137844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.137844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.138066] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.138215] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.163863] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: IN_PROGRESS for 2s [ 811.205038] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.522552] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bd87a172-9e18-4eb7-aeaf-9dfe8525167b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.533551] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.533720] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.533797] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.534101] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.534202] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.534444] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.534546] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.534624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.534788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.534866] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.534970] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bd87a172-9e18-4eb7-aeaf-9dfe8525167b is going to be deleted. [ 811.537459] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.538685] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.538840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.539045] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.539142] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.539212] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.539396] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.539502] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.539563] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.539722] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.539811] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.540111] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 is going to be updated. [ 811.545988] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df60b3b7-a928-4d44-8a9e-0fb83f522e16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.569720] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.569979] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.569979] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.570354] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.570354] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.575403] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.575669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.575669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.575949] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.575949] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.576160] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bd87a172-9e18-4eb7-aeaf-9dfe8525167b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.580782] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 in Status: IN_PROGRESS for 2s [ 811.708406] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.025400] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bd87a172-9e18-4eb7-aeaf-9dfe8525167b: rpc.has_security_group_logging(os_id): False [ 812.044059] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.049310] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.049452] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.049815] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.050239] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.050239] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.050319] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.050373] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.050803] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.050875] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.050992] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.051136] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd87a172-9e18-4eb7-aeaf-9dfe8525167b is going to be created. [ 812.054797] env[65322]: INFO networking_nsxv3.common.synchronization [req-57519d0a-97dc-4bba-9a6e-fb5429910ac3 req-1a1f32ac-c294-4dbb-b56d-f2656b3b1e80 tempest-ListServerFiltersTestJSON-548115459 tempest-ListServerFiltersTestJSON-548115459-project-member] Enqueued Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGHEST for action security_group_members [ 812.055227] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df60b3b7-a928-4d44-8a9e-0fb83f522e16: rpc.has_security_group_logging(os_id): False [ 812.057058] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGHEST for action security_group_members [ 812.058146] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.058146] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.058146] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.058386] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.058602] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.058707] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.058754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.059389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.059505] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.059564] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.077923] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/bd87a172-9e18-4eb7-aeaf-9dfe8525167b], does not exist path=[/infra/domains/default/groups/bd87a172-9e18-4eb7-aeaf-9dfe8525167b]."\n}' [ 812.077923] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd87a172-9e18-4eb7-aeaf-9dfe8525167b failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/bd87a172-9e18-4eb7-aeaf-9dfe8525167b [ 812.078143] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 812.081584] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.081584] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.081584] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.081584] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.081584] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.081584] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.081985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.081985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.081985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.081985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.082237] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 is going to be updated. [ 812.122604] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.122604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.122604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.122970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.127305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.127305] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.127305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.127305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.127305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.127305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.127305] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.127305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.127305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.127305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.127305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.127305] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd87a172-9e18-4eb7-aeaf-9dfe8525167b is going to be created. [ 812.147472] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/bd87a172-9e18-4eb7-aeaf-9dfe8525167b], does not exist path=[/infra/domains/default/groups/bd87a172-9e18-4eb7-aeaf-9dfe8525167b]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/bd87a172-9e18-4eb7-aeaf-9dfe8525167b [ 812.148306] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd87a172-9e18-4eb7-aeaf-9dfe8525167b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.149028] env[65322]: Traceback (most recent call last): [ 812.149028] env[65322]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 812.149028] env[65322]: return func(*args, **kwargs) [ 812.149028] env[65322]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 812.149028] env[65322]: res.raise_for_status() [ 812.149028] env[65322]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 812.149028] env[65322]: raise HTTPError(http_error_msg, response=self) [ 812.149028] env[65322]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/bd87a172-9e18-4eb7-aeaf-9dfe8525167b [ 812.149028] env[65322]: During handling of the above exception, another exception occurred: [ 812.149028] env[65322]: Traceback (most recent call last): [ 812.149028] env[65322]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 812.149028] env[65322]: listener.cb(fileno) [ 812.149028] env[65322]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 812.149028] env[65322]: result = function(*args, **kwargs) [ 812.149028] env[65322]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 812.149028] env[65322]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 812.149028] env[65322]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 812.149028] env[65322]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 812.149028] env[65322]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 812.149028] env[65322]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 812.149028] env[65322]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 812.149028] env[65322]: res.raise_for_status() [ 812.149028] env[65322]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 812.149028] env[65322]: raise HTTPError(http_error_msg, response=self) [ 812.149028] env[65322]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/bd87a172-9e18-4eb7-aeaf-9dfe8525167b [ 812.149028] env[65322]: Removing descriptor: 17 [ 812.152998] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.153160] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.153257] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.153445] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.153580] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.168485] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 in Status: IN_PROGRESS for 2s [ 812.211999] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.212205] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.212384] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.212634] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.212891] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.212995] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 is going to be updated. [ 812.280030] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.280245] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.280294] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.280635] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.280635] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.293373] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: IN_PROGRESS for 2s [ 812.356413] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.356413] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.356771] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.356771] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.356882] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.558612] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.558769] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.558828] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.559146] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.559146] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.559259] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e65996f-05e7-4178-bdb9-30270bc56380 is going to be updated. [ 812.563842] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.603292] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.603292] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.603292] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.603541] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.603676] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.618304] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: IN_PROGRESS for 2s [ 812.860411] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.068253] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.186330] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: SUCCESS [ 813.186330] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.186330] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.186330] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.186665] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.362437] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.385179] env[65322]: INFO networking_nsxv3.common.synchronization [req-1c153be6-8780-4de9-91b7-0c6bdfc3d622 req-f22c5094-d779-4026-97f7-bf599bce3bed tempest-ImagesTestJSON-2080608290 tempest-ImagesTestJSON-2080608290-project-member] Enqueued Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 813.385179] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 813.387412] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.388899] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.388991] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.389220] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.389402] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.389826] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.389907] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.390081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.390161] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.390259] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.576214] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.576443] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.576443] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.576663] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.576756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.576855] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eae2009-1124-44b2-a496-3582997767b0 is going to be updated. [ 813.594943] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 in Status: SUCCESS [ 813.595242] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 deletion is rescheduled due to dependency. [ 813.595424] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.620025] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.620025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.620025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.620025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.620025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.634371] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eae2009-1124-44b2-a496-3582997767b0 in Status: IN_PROGRESS for 2s [ 813.689581] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.689817] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.817248] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-564 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.817449] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-564" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.817563] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-564" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.817860] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-564" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.818124] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.818266] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.819029] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.819029] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.819029] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.819029] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 813.819315] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 813.819513] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 813.819705] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 813.819861] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 813.820054] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 813.820257] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 813.841090] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 813.842023] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 813.842705] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 813.844662] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-564" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.845248] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-ff8e7535-1d5b-4e80-9efa-67d228dbc543 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.845486] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-ff8e7535-1d5b-4e80-9efa-67d228dbc543" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.847151] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-ff8e7535-1d5b-4e80-9efa-67d228dbc543" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.847151] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-ff8e7535-1d5b-4e80-9efa-67d228dbc543" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.847151] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff8e7535-1d5b-4e80-9efa-67d228dbc543',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.864829] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 813.865181] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 813.892233] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.892421] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.892464] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.892650] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.913241] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.913656] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.913795] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.913858] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.914049] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.914137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.914220] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 is going to be updated. [ 813.940623] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.940867] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.940955] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.941245] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.941312] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.951431] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: IN_PROGRESS for 2s [ 814.183778] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 in Status: SUCCESS [ 814.184111] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.305366] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: SUCCESS [ 814.305366] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.306678] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.306678] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.306678] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.306678] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.306678] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.306678] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.306678] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.306678] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.306678] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.306678] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.306678] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.307246] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.307246] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.307246] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.307246] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.307246] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.307246] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.307450] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.307450] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.349765] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.349765] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.349765] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.350138] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.350529] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.350529] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port ff8e7535-1d5b-4e80-9efa-67d228dbc543 not found, creating... [ 814.350825] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.351030] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.351615] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.351615] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.351615] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.352095] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.352393] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.352771] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.352859] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.353282] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.353282] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: ff8e7535-1d5b-4e80-9efa-67d228dbc543 is going to be created. [ 814.388377] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.388603] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.388682] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.388927] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.389167] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.389375] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-ff8e7535-1d5b-4e80-9efa-67d228dbc543" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.631478] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: SUCCESS [ 814.631701] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.632146] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.632391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.632561] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.632678] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.632743] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.632938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.633023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.633103] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.633196] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.806688] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.806957] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.807068] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.807368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.820874] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 814.821835] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.822894] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 814.824018] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ed63561-0704-4a50-8dc8-a078d5c0c6f3: rpc.has_security_group_logging(os_id): False [ 814.844578] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.844693] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.844759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.845194] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.845194] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.845351] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.845453] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.845453] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.845955] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.845955] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.845955] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.845955] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.846200] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.846200] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.846200] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.846632] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.846760] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.846898] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.847063] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.847145] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.847279] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 is going to be created. [ 814.851099] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.851099] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.851311] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.851348] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.857329] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.858520] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 814.858520] env[65322]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65322) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 814.858520] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 814.893529] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.893904] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.893904] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.893986] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.894800] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.894876] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 814.917289] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.917435] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.917499] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.917708] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.917966] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.932101] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: IN_PROGRESS for 2s [ 814.992938] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.993192] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.993267] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.993587] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.993926] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.994588] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 815.121776] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.121776] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.121776] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.121776] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.121776] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.121776] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:36. [ 815.121776] env[65322]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'a34cfbc5-e3ce-4943-8058-702a82703915', '9d816765-57fa-4e08-a1ce-762a921d5096', 'f508506d-1a05-435a-98ce-ae1f55ed3c92', '4eae2009-1124-44b2-a496-3582997767b0', 'bcde6be3-c7fe-48ef-8d48-e1af8b6219a2', '6e834e6a-77bf-4cd6-92bf-e7ad79ee2707', '26df6822-523e-4c95-9d74-db0cddb065c0', 'cf5d3fd5-a83d-454c-811a-c9b2e590ac47', 'b782aecb-f199-4bcf-9857-f670ec188036', '3a07e97d-006e-4334-801f-7251980b19f1', 'd7c8bab2-b339-4d16-b55e-addae517cd81', '3ed63561-0704-4a50-8dc8-a078d5c0c6f3', '3b868ada-e2d6-41f0-b807-c024a41e03d9', 'd1550bb0-c88b-4864-824e-b80ca3b52834', '7e65996f-05e7-4178-bdb9-30270bc56380', '02830029-f973-4892-9d06-f25f8aee730a', '88219fc7-d04d-4a0f-88d0-399f8bd7ef8e', '60b11f04-8768-43f5-bcb0-8bb51ec0bdf2', 'e863a544-814a-4bca-b4b1-35f9a61afcd3', 'df60b3b7-a928-4d44-8a9e-0fb83f522e16', 'c552e7e9-dc55-4efc-afb8-91a443d0679a', '506e677b-3a46-4740-8e93-f6dcf6d18933', '0300d669-cfda-4a93-9701-2092bc2115c1', '260ad733-0f5d-43fb-be04-c8ecbbbcea08', 'e4dca03f-65fb-4951-910c-8904302d70fa', '7f4b8024-2bac-4f34-a6d3-9d32d83408c9', '16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16', 'aa7cb676-7b51-4e93-980a-5540e7a7e88b', '8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd', '739eb2bf-8f60-406e-b099-1671d90b8545', 'bde2ba93-08d3-4359-9ce7-0ff97de68964', '1d03ae1b-566c-4270-87f0-fce3e636d072', '51992ebb-4768-42b5-9c53-db9beef2ee89', 'b43d5c58-0cb4-4f14-b009-7fe58147ee41', '694536fa-8e1e-4cf0-9017-118a0337a180', '08f780ea-bce2-462d-b3b7-63ec1260a6bb'} {{(pid=65322) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 815.121776] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 815.135796] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.136008] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.136071] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.136307] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.136561] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.136561] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.136682] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.137083] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.137083] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.137083] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.137083] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.137263] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.137263] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.137417] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.137697] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.137697] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.137697] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.137904] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.137904] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.137904] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.138101] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.146785] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.147019] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.147019] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.147269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.147340] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.147583] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 815.147674] env[65322]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65322) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 815.147804] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 815.175697] env[65322]: INFO networking_nsxv3.common.synchronization [req-1c153be6-8780-4de9-91b7-0c6bdfc3d622 req-2d3aa121-9bf2-4353-aa2d-17143f75807d service nova] Enqueued Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_rules [ 815.175817] env[65322]: INFO networking_nsxv3.common.synchronization [req-1c153be6-8780-4de9-91b7-0c6bdfc3d622 req-2d3aa121-9bf2-4353-aa2d-17143f75807d service nova] Enqueued Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 815.175859] env[65322]: INFO networking_nsxv3.common.synchronization [req-1c153be6-8780-4de9-91b7-0c6bdfc3d622 req-2d3aa121-9bf2-4353-aa2d-17143f75807d service nova] Enqueued Resource ID: ff8e7535-1d5b-4e80-9efa-67d228dbc543 with Priority: HIGHEST for action port [ 815.176482] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_rules [ 815.176627] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 815.176721] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff8e7535-1d5b-4e80-9efa-67d228dbc543 with Priority: HIGHEST for action port [ 815.177037] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.177248] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.177248] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.177469] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.177532] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.178551] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.178674] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.178821] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff8e7535-1d5b-4e80-9efa-67d228dbc543 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.179361] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff8e7535-1d5b-4e80-9efa-67d228dbc543" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.179361] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff8e7535-1d5b-4e80-9efa-67d228dbc543" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.183011] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff8e7535-1d5b-4e80-9efa-67d228dbc543" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.183011] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff8e7535-1d5b-4e80-9efa-67d228dbc543',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.223499] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.223683] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.223730] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.224029] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.228022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.228022] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 815.228318] env[65322]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65322) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 815.228318] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 815.228413] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 815.228747] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/36 resources of Type:Security Group Rules [ 815.228883] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGH for action security_group_rules [ 815.228930] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9d816765-57fa-4e08-a1ce-762a921d5096 with Priority: HIGH for action security_group_rules [ 815.228989] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f508506d-1a05-435a-98ce-ae1f55ed3c92 with Priority: HIGH for action security_group_rules [ 815.229092] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGH for action security_group_rules [ 815.229174] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 with Priority: HIGH for action security_group_rules [ 815.229265] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 with Priority: HIGH for action security_group_rules [ 815.229308] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 26df6822-523e-4c95-9d74-db0cddb065c0 with Priority: HIGH for action security_group_rules [ 815.229405] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cf5d3fd5-a83d-454c-811a-c9b2e590ac47 with Priority: HIGH for action security_group_rules [ 815.229441] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b782aecb-f199-4bcf-9857-f670ec188036 with Priority: HIGH for action security_group_rules [ 815.229482] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGH for action security_group_rules [ 815.229560] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d7c8bab2-b339-4d16-b55e-addae517cd81 with Priority: HIGH for action security_group_rules [ 815.229608] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGH for action security_group_rules [ 815.229711] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 with Priority: HIGH for action security_group_rules [ 815.229759] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGH for action security_group_rules [ 815.229831] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGH for action security_group_rules [ 815.229922] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGH for action security_group_rules [ 815.229997] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e with Priority: HIGH for action security_group_rules [ 815.230100] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 with Priority: HIGH for action security_group_rules [ 815.230161] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGH for action security_group_rules [ 815.230221] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 with Priority: HIGH for action security_group_rules [ 815.230332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.641170] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e65996f-05e7-4178-bdb9-30270bc56380: rpc.has_security_group_logging(os_id): False [ 815.645033] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eae2009-1124-44b2-a496-3582997767b0 in Status: SUCCESS [ 815.645247] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.662501] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.662588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.662626] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.662955] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.683901] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.684186] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.684313] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.684439] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.684641] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.684732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.685243] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.685355] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.685419] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.685571] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.685644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.685994] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.685994] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.685994] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.686330] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.686408] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.686492] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e65996f-05e7-4178-bdb9-30270bc56380 is going to be updated. [ 815.687722] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.687859] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.687969] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff8e7535-1d5b-4e80-9efa-67d228dbc543 with status ACTIVE [ 815.688127] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.688219] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.688280] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.688422] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.688818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.688818] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.688818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.688818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.688997] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.688997] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.689338] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.689338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.689338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.689480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.689521] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.689570] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff8e7535-1d5b-4e80-9efa-67d228dbc543 is going to be updated. [ 815.713817] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.714553] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.714553] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.714680] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.714775] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.715034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff8e7535-1d5b-4e80-9efa-67d228dbc543" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.755908] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.755908] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.756035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.756186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.756362] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.793262] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: IN_PROGRESS for 2s [ 815.964156] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: SUCCESS [ 815.965369] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 deletion is rescheduled due to dependency. [ 815.966217] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.966275] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.966693] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.967060] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.967341] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.967521] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.967881] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.968104] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.968340] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.470402] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.949546] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: SUCCESS [ 816.949774] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.949957] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.950263] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.950263] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.974256] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.453539] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.453736] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.453820] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.454103] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.454300] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.454405] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.454466] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.454622] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.454704] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.455029] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.455029] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.476896] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.477126] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.477126] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.477386] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.477386] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.478063] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 is going to be updated. [ 817.524828] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.525064] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.525180] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.525501] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.525759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.538577] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: IN_PROGRESS for 2s [ 817.812596] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: SUCCESS [ 817.812596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.958298] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.958298] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.958298] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.958298] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.958298] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.958298] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.958298] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.958298] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.958298] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.958650] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.958650] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.958650] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.958650] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.958778] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.959593] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.959593] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.959593] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.959882] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.959882] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.960084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.960084] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.275212] env[65322]: INFO networking_nsxv3.common.synchronization [req-04a3353a-f3bb-4102-a203-8a873cec5917 req-65555002-0927-4bea-baad-39c2f65a9a59 tempest-ServerActionsTestOtherA-1162989957 tempest-ServerActionsTestOtherA-1162989957-project-member] Enqueued Resource ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 with Priority: HIGHEST for action security_group_members [ 818.275952] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 with Priority: HIGHEST for action security_group_members [ 818.276217] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGH for action security_group_rules [ 818.276302] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f508506d-1a05-435a-98ce-ae1f55ed3c92 with Priority: HIGH for action security_group_rules [ 818.276357] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26df6822-523e-4c95-9d74-db0cddb065c0 with Priority: HIGH for action security_group_rules [ 818.276456] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGH for action security_group_rules [ 818.277534] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 with Priority: HIGH for action security_group_rules [ 818.277657] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGH for action security_group_rules [ 818.277773] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 with Priority: HIGH for action security_group_rules [ 818.277849] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e with Priority: HIGH for action security_group_rules [ 818.277936] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGH for action security_group_rules [ 818.278029] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02830029-f973-4892-9d06-f25f8aee730a with Priority: HIGH for action security_group_rules [ 818.278124] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 with Priority: HIGH for action security_group_rules [ 818.278196] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGH for action security_group_rules [ 818.278317] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7c8bab2-b339-4d16-b55e-addae517cd81 with Priority: HIGH for action security_group_rules [ 818.278406] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGH for action security_group_rules [ 818.278468] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b782aecb-f199-4bcf-9857-f670ec188036 with Priority: HIGH for action security_group_rules [ 818.278515] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 with Priority: HIGH for action security_group_rules [ 818.278758] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf5d3fd5-a83d-454c-811a-c9b2e590ac47 with Priority: HIGH for action security_group_rules [ 818.278758] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 with Priority: HIGH for action security_group_rules [ 818.278758] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d816765-57fa-4e08-a1ce-762a921d5096 with Priority: HIGH for action security_group_rules [ 818.278918] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGH for action security_group_rules [ 818.279146] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.279808] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.279903] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.280153] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.281207] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.281207] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.281207] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.281207] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.281416] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.281503] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42a0bf4e-f927-429d-910f-f0fec4b5f3c8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.282788] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.282788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.282788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.282788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.282990] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.283642] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f508506d-1a05-435a-98ce-ae1f55ed3c92 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.283765] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.283803] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.283972] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.284054] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f508506d-1a05-435a-98ce-ae1f55ed3c92',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.284895] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26df6822-523e-4c95-9d74-db0cddb065c0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.285274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.285274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.285492] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.285531] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26df6822-523e-4c95-9d74-db0cddb065c0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.288031] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.288031] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.288031] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.288031] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.288031] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.290229] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df60b3b7-a928-4d44-8a9e-0fb83f522e16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.291038] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.291038] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.291038] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.291038] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df60b3b7-a928-4d44-8a9e-0fb83f522e16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.292691] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.292791] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.292867] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.293059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.293136] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.296128] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.296250] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.296310] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.296469] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.296540] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60b11f04-8768-43f5-bcb0-8bb51ec0bdf2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.298696] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.298696] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.298696] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.298696] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.298696] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88219fc7-d04d-4a0f-88d0-399f8bd7ef8e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.299945] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1550bb0-c88b-4864-824e-b80ca3b52834 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.299945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.299945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.300138] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.300236] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.301260] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02830029-f973-4892-9d06-f25f8aee730a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.301357] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.301425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.301596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.301668] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02830029-f973-4892-9d06-f25f8aee730a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.304621] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3b868ada-e2d6-41f0-b807-c024a41e03d9 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.304693] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.304744] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.304917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.304989] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3b868ada-e2d6-41f0-b807-c024a41e03d9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.305910] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.306010] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.306201] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7c8bab2-b339-4d16-b55e-addae517cd81 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.306297] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.306360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.306509] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.306581] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7c8bab2-b339-4d16-b55e-addae517cd81',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.307423] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.307526] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.307590] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.307739] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.307804] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.308848] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b782aecb-f199-4bcf-9857-f670ec188036 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.308848] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.308848] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.309038] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.309038] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b782aecb-f199-4bcf-9857-f670ec188036',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.469092] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.469092] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.469092] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.469092] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.469092] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e834e6a-77bf-4cd6-92bf-e7ad79ee2707',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.469092] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf5d3fd5-a83d-454c-811a-c9b2e590ac47 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.469092] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.469092] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.469092] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.469092] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf5d3fd5-a83d-454c-811a-c9b2e590ac47',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.469092] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.469092] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.469092] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.469908] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.469908] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bcde6be3-c7fe-48ef-8d48-e1af8b6219a2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.470248] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d816765-57fa-4e08-a1ce-762a921d5096 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.470379] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.470437] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.470542] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.470610] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d816765-57fa-4e08-a1ce-762a921d5096',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.471476] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.471601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.471661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.473296] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.473296] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.473296] env[65322]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 818.476504] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-26df6822-523e-4c95-9d74-db0cddb065c0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.476504] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.476504] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.476504] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.476504] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.476504] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.476981] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.476981] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.476981] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.477094] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.477094] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('26df6822-523e-4c95-9d74-db0cddb065c0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.481590] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.482016] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.482016] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.482016] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.482205] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.483823] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.483823] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.483823] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.483823] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.483823] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.483823] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 already deleted. [ 818.483823] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.484176] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ed63561-0704-4a50-8dc8-a078d5c0c6f3: rpc.has_security_group_logging(os_id): False [ 818.521556] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.521829] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.521829] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.522159] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.522159] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.522301] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.522389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.522439] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.522577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.522653] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.522840] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.522968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.523046] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.523195] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.523267] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.523460] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.524400] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.524400] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.524400] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.524400] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.524400] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 is going to be updated. [ 818.602775] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.602775] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.602775] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.602775] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.602775] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.620899] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: IN_PROGRESS for 2s [ 818.722104] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-315 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.722328] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-315" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.722457] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-315" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.722706] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-315" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.723059] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.723202] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.723315] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.723531] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.723672] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.723884] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 818.724075] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 818.724188] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 818.724292] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 818.724396] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 818.724494] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 818.724624] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 818.756591] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 818.756779] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 818.756941] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 818.757089] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-315" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.757439] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-9bd3d4c0-b16b-4da4-8a0c-f2067349ff60 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.757592] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-9bd3d4c0-b16b-4da4-8a0c-f2067349ff60" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.757704] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-9bd3d4c0-b16b-4da4-8a0c-f2067349ff60" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.758062] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-9bd3d4c0-b16b-4da4-8a0c-f2067349ff60" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.758204] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bd3d4c0-b16b-4da4-8a0c-f2067349ff60',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.987952] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-26df6822-523e-4c95-9d74-db0cddb065c0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.988180] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.988663] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.988663] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.988795] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.988924] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.989068] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.989238] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.989358] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.989489] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.989698] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-26df6822-523e-4c95-9d74-db0cddb065c0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.989834] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.989924] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.990144] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.990341] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.990484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.990584] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.990804] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.990983] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.991078] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.991200] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('26df6822-523e-4c95-9d74-db0cddb065c0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.001898] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.002110] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.002110] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.002395] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.004496] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.004667] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.028255] env[65322]: INFO networking_nsxv3.common.synchronization [req-e581766f-8880-4415-94c9-f208fb96151b req-4d73fff2-def3-49e4-9a8d-78b45c101f00 tempest-ServersTestManualDisk-537044773 tempest-ServersTestManualDisk-537044773-project-member] Enqueued Resource ID: 7f4b8024-2bac-4f34-a6d3-9d32d83408c9 with Priority: HIGHEST for action security_group_members [ 819.038902] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f4b8024-2bac-4f34-a6d3-9d32d83408c9 with Priority: HIGHEST for action security_group_members [ 819.054621] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.055047] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.055618] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.055789] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 is going to be deleted. [ 819.058402] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.058629] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.058629] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.058758] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.062485] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.062710] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.062710] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.062962] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.063275] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.063383] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.063433] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.063618] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.063782] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.063837] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.063894] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60b11f04-8768-43f5-bcb0-8bb51ec0bdf2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.065978] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.066143] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.066200] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.066341] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.067914] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.067914] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.067914] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.067914] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.067914] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.067914] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.067914] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.068350] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.068466] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.068528] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.068674] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.069629] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.069629] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.069629] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.069629] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.069629] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.069629] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.069629] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.072605] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7f4b8024-2bac-4f34-a6d3-9d32d83408c9 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.072898] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.072898] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.073024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.073197] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.073302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.073360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.074218] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.074218] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.074218] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7f4b8024-2bac-4f34-a6d3-9d32d83408c9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.134458] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.134701] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.135937] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.136087] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.136941] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.137076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.137834] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.137938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.138740] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.138836] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.139562] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.139678] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.140440] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.140539] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.141444] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.141545] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e834e6a-77bf-4cd6-92bf-e7ad79ee2707 is going to be deleted. [ 819.143375] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.143481] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.143541] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.143757] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.145709] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.145818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.146673] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.146774] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.147501] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.147904] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.168033] env[65322]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 819.168576] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.168753] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7c8bab2-b339-4d16-b55e-addae517cd81 is going to be deleted. [ 819.171354] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.171580] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.193108] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.193307] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.195506] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.195698] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f508506d-1a05-435a-98ce-ae1f55ed3c92 is going to be deleted. [ 819.197039] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.197386] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.225544] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.225713] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02830029-f973-4892-9d06-f25f8aee730a is going to be deleted. [ 819.228043] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.228043] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.260835] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.261293] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.261481] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.262201] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.262437] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.262684] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 9bd3d4c0-b16b-4da4-8a0c-f2067349ff60 not found, creating... [ 819.263162] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.263420] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.263634] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.263954] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.264198] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.264933] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.264933] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.265193] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.265466] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.265579] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.265813] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 9bd3d4c0-b16b-4da4-8a0c-f2067349ff60 is going to be created. [ 819.273688] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.274841] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.308141] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.308487] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b782aecb-f199-4bcf-9857-f670ec188036 is going to be deleted. [ 819.310488] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.310488] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.355210] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.355411] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.380322] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.380510] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.393756] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.394062] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.394248] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.394720] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.394840] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.395126] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-9bd3d4c0-b16b-4da4-8a0c-f2067349ff60" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.405385] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.405385] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf5d3fd5-a83d-454c-811a-c9b2e590ac47 is going to be deleted. [ 819.405385] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.405385] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.413253] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.413253] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.470344] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.470511] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88219fc7-d04d-4a0f-88d0-399f8bd7ef8e is going to be deleted. [ 819.471816] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.472580] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.493464] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 26df6822-523e-4c95-9d74-db0cddb065c0: rpc.has_security_group_logging(os_id): False [ 819.508128] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.508369] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.577039] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.577039] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.577039] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.577549] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.578198] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.578198] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.578198] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.578461] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.578461] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.578547] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.578788] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.578918] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.578982] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.579575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.579575] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.579722] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.579722] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.579998] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.579998] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.580263] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.580263] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.581494] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.581632] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.581686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.581822] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.582067] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.582067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.582266] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.582350] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.582424] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.582516] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.582664] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.582756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.582811] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.583059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.583204] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.583299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.583427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.583938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.583938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.583938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.583938] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60b11f04-8768-43f5-bcb0-8bb51ec0bdf2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.584851] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.585022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.585022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.585259] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.585259] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.585477] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.585519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.585920] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.585920] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.585920] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.586172] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.586172] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.586172] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.586445] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.586520] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.587260] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.587260] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.587260] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.587260] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.587260] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.587260] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.589311] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.589452] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.603343] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.603539] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.604362] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: SUCCESS [ 819.604594] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.605683] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.605921] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.606187] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.606299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.606299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.606536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.606536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.606626] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.606710] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.610190] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.610190] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.614250] env[65322]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 819.615123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.615278] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be deleted. [ 819.616902] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.617371] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.717699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.718016] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a07e97d-006e-4334-801f-7251980b19f1 is going to be deleted. [ 819.721253] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.721776] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.753192] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.754269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.772995] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.773186] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df60b3b7-a928-4d44-8a9e-0fb83f522e16 is going to be deleted. [ 819.774503] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.774628] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.825715] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.825878] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3b868ada-e2d6-41f0-b807-c024a41e03d9 is going to be deleted. [ 819.827189] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.827980] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.855593] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.855593] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.894259] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.894455] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.897240] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.897451] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.904697] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.904875] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1550bb0-c88b-4864-824e-b80ca3b52834 is going to be deleted. [ 819.905936] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.906204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.002911] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.002911] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d816765-57fa-4e08-a1ce-762a921d5096 is going to be deleted. [ 820.002911] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.003178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.024778] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.025017] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.053057] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.053352] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.060049] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.060265] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bcde6be3-c7fe-48ef-8d48-e1af8b6219a2 is going to be deleted. [ 820.061464] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.061902] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.061999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.062243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.062464] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.062699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.062952] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.063188] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e834e6a-77bf-4cd6-92bf-e7ad79ee2707" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.063836] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.064066] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.064164] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.064360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7c8bab2-b339-4d16-b55e-addae517cd81" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.065587] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.065808] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.065936] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.066094] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f508506d-1a05-435a-98ce-ae1f55ed3c92" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.066281] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.066453] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.066550] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.066671] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02830029-f973-4892-9d06-f25f8aee730a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.066803] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.066948] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.067038] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.067388] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b782aecb-f199-4bcf-9857-f670ec188036" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.067388] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.068038] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.089546] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e65996f-05e7-4178-bdb9-30270bc56380: rpc.has_security_group_logging(os_id): False [ 820.090701] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2: rpc.has_security_group_logging(os_id): False [ 820.091645] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4eae2009-1124-44b2-a496-3582997767b0: rpc.has_security_group_logging(os_id): False [ 820.109779] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.109961] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.110068] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.110306] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.110970] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.110970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.110970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.110970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.110970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.110970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.111404] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.111404] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.111404] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.111404] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.111534] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.111635] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.111677] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.111810] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.111883] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.111960] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.112155] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.117545] env[65322]: INFO networking_nsxv3.common.synchronization [req-04a3353a-f3bb-4102-a203-8a873cec5917 req-527ef904-d45d-4ab8-9da3-db95f7a35924 service nova] Enqueued Resource ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 with Priority: HIGHEST for action security_group_rules [ 820.117545] env[65322]: INFO networking_nsxv3.common.synchronization [req-04a3353a-f3bb-4102-a203-8a873cec5917 req-527ef904-d45d-4ab8-9da3-db95f7a35924 service nova] Enqueued Resource ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 with Priority: HIGHEST for action security_group_members [ 820.117545] env[65322]: INFO networking_nsxv3.common.synchronization [req-04a3353a-f3bb-4102-a203-8a873cec5917 req-527ef904-d45d-4ab8-9da3-db95f7a35924 service nova] Enqueued Resource ID: 9bd3d4c0-b16b-4da4-8a0c-f2067349ff60 with Priority: HIGHEST for action port [ 820.117545] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 with Priority: HIGHEST for action security_group_rules [ 820.117545] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 with Priority: HIGHEST for action security_group_members [ 820.117545] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bd3d4c0-b16b-4da4-8a0c-f2067349ff60 with Priority: HIGHEST for action port [ 820.117545] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42a0bf4e-f927-429d-910f-f0fec4b5f3c8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.117545] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.117545] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.117545] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.117545] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42a0bf4e-f927-429d-910f-f0fec4b5f3c8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.118302] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.118302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.118302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.118570] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.118634] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.118766] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.118828] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.119029] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.119178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.119232] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42a0bf4e-f927-429d-910f-f0fec4b5f3c8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.120089] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bd3d4c0-b16b-4da4-8a0c-f2067349ff60 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.120224] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bd3d4c0-b16b-4da4-8a0c-f2067349ff60" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.120288] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bd3d4c0-b16b-4da4-8a0c-f2067349ff60" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.120439] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bd3d4c0-b16b-4da4-8a0c-f2067349ff60" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.120533] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bd3d4c0-b16b-4da4-8a0c-f2067349ff60',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.130432] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.130432] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.131832] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.132020] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.139757] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.139757] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.147432] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.147692] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.147825] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.147974] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.148872] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.148872] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.148872] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f4b8024-2bac-4f34-a6d3-9d32d83408c9 is going to be updated. [ 820.149497] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.150164] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.156968] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.156968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.292324] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.292620] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.292750] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.292807] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.293108] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.293178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.293385] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.293488] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.293551] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.293712] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.293783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.293979] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.294077] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.294113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.294250] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.294354] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.294479] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26df6822-523e-4c95-9d74-db0cddb065c0 is going to be updated. [ 820.296048] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.296822] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.296822] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.296822] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf5d3fd5-a83d-454c-811a-c9b2e590ac47" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.296822] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.296822] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.296822] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.297121] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88219fc7-d04d-4a0f-88d0-399f8bd7ef8e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.297121] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.298112] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.298112] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.298112] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.298112] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.298112] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.298112] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.298112] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.298480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.298637] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.298714] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.298915] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df60b3b7-a928-4d44-8a9e-0fb83f522e16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.299054] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.299667] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.299667] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.299667] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3b868ada-e2d6-41f0-b807-c024a41e03d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.299667] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.299667] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.300162] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.300162] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.300162] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.300162] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.300162] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.300378] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.300492] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.300545] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.300689] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.301104] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.301104] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.301264] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.301264] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.301358] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.301425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.301659] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.301742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.301842] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.301931] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.302011] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.302957] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e65996f-05e7-4178-bdb9-30270bc56380 is going to be updated. [ 820.304118] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.304272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.333514] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.334025] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.334025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.334223] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.334306] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.334440] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.334611] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.338149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.338149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.338149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.338149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.338149] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.338149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.338149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.338149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.338149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.338149] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 is going to be updated. [ 820.338149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.338149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.338149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.338149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d816765-57fa-4e08-a1ce-762a921d5096" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.338719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.338719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.340641] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.340851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.340947] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.341139] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.341289] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.344089] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.344243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.373061] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f4b8024-2bac-4f34-a6d3-9d32d83408c9 in Status: IN_PROGRESS for 2s [ 820.383426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.383704] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.383969] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.384040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.384562] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.384562] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.384562] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.384757] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.384757] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.384889] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.384889] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.385057] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.385131] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.385230] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.385355] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.385426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.385570] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4eae2009-1124-44b2-a496-3582997767b0 is going to be updated. [ 820.387115] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.387284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.387512] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.387512] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bcde6be3-c7fe-48ef-8d48-e1af8b6219a2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.458503] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.458645] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.458716] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.458926] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.460723] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.474072] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.474310] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.474394] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.474670] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.474996] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.481934] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26df6822-523e-4c95-9d74-db0cddb065c0 in Status: IN_PROGRESS for 2s [ 820.519656] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.519656] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.520028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.521158] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.521348] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.527877] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: IN_PROGRESS for 2s [ 820.542148] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.542457] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.542605] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.542851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.543137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.547530] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 in Status: IN_PROGRESS for 2s [ 820.610161] env[65322]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 820.612743] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eae2009-1124-44b2-a496-3582997767b0 in Status: IN_PROGRESS for 2s [ 820.614287] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16: rpc.has_security_group_logging(os_id): False [ 820.625423] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42a0bf4e-f927-429d-910f-f0fec4b5f3c8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.625569] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.625569] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.625748] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9bd3d4c0-b16b-4da4-8a0c-f2067349ff60 with status ACTIVE [ 820.628023] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.628023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.628023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.628023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.629277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.630023] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.630023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.630023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.630023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.630737] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.630737] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.630737] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.630737] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.630737] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.631101] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.631101] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9bd3d4c0-b16b-4da4-8a0c-f2067349ff60 is going to be updated. [ 820.652787] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.654139] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.654392] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.654654] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.672729] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: SUCCESS [ 820.672729] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.672729] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.672729] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.672729] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.678427] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.678427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.678427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.678427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.678427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.678427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bd3d4c0-b16b-4da4-8a0c-f2067349ff60" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.683391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.683391] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.683391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.683391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.683391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.683391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.683391] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.683391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.683391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.683391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.683391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.683391] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.683391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.683391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.684387] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.684625] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.684904] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 is going to be updated. [ 820.776498] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.776806] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.776806] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.776947] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.777117] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.811224] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: IN_PROGRESS for 2s [ 821.135121] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42a0bf4e-f927-429d-910f-f0fec4b5f3c8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.174602] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.174827] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.174979] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.175244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.175432] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.175628] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.175691] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.175877] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.175986] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.176094] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.176187] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.637928] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.638303] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.638303] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.638459] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.638512] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.638619] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 is going to be created. [ 821.670427] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.670427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.670660] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.670846] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.671075] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.680067] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.680211] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.680282] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.680508] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.680663] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.680757] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.680909] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.681150] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.681235] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.681320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.681471] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.681560] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.681616] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.682079] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.682257] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.682353] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.682418] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.682554] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.684999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.684999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.684999] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.686652] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 in Status: UNINITIALIZED for 2s [ 822.187165] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ed63561-0704-4a50-8dc8-a078d5c0c6f3: rpc.has_security_group_logging(os_id): False [ 822.209903] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.210075] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.210139] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.210354] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.210444] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.210649] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.210746] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.210832] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.212783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.212991] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.213327] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.213862] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.214070] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.214174] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.214245] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.214456] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.215037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.215037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.215037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.215037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.215037] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 is going to be updated. [ 822.319489] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.319690] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.319690] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.320019] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.320114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.338193] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: IN_PROGRESS for 2s [ 822.384169] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7f4b8024-2bac-4f34-a6d3-9d32d83408c9 in Status: SUCCESS [ 822.384371] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7f4b8024-2bac-4f34-a6d3-9d32d83408c9 deletion is rescheduled due to dependency. [ 822.384493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7f4b8024-2bac-4f34-a6d3-9d32d83408c9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.507853] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 26df6822-523e-4c95-9d74-db0cddb065c0 in Status: SUCCESS [ 822.508308] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.548656] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: SUCCESS [ 822.548885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.559387] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 in Status: SUCCESS [ 822.559606] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.628891] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eae2009-1124-44b2-a496-3582997767b0 in Status: SUCCESS [ 822.629205] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.827683] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: SUCCESS [ 822.828030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.699201] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 in Status: SUCCESS [ 823.699601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.699714] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.699920] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.700162] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.700296] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.700378] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.700580] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.700673] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.700782] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.701030] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('42a0bf4e-f927-429d-910f-f0fec4b5f3c8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.204885] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.205187] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.205187] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.205370] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.205548] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.205652] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.205714] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.205877] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.205987] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.206130] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.206251] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.206341] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.206402] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.206542] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.206680] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.206818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.206879] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.207027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.207109] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.207191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.207282] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('42a0bf4e-f927-429d-910f-f0fec4b5f3c8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.356113] env[65322]: INFO networking_nsxv3.common.synchronization [req-004ba873-2b66-4135-8b08-84a51e18afd4 req-ec4be1cd-f540-4bf6-a96e-a9c6234b519d tempest-ServerRescueNegativeTestJSON-325476461 tempest-ServerRescueNegativeTestJSON-325476461-project-member] Enqueued Resource ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 with Priority: HIGHEST for action security_group_members [ 824.356113] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 with Priority: HIGHEST for action security_group_members [ 824.356113] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.356113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.356113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.356113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.356113] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.356113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.356113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.357178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.357178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.357178] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bf5edc0-c1b5-489c-9093-35e6cf4bd266',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.358280] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: SUCCESS [ 824.358422] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.709314] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 42a0bf4e-f927-429d-910f-f0fec4b5f3c8: rpc.has_security_group_logging(os_id): False [ 824.732055] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.732260] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.732339] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.732545] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.732635] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.732975] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.733203] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.733334] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.733582] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.733765] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.734232] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.734350] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.734446] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.734596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.734725] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.734996] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.735128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.735267] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.735709] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.735709] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.735709] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 is going to be created. [ 824.747780] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-167 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.748045] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-167" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.748221] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-167" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.748570] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-167" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.748984] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.749328] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.749447] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.749701] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.749826] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.750115] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 824.750226] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 824.750330] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 824.750430] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 824.750531] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 824.750645] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 824.750770] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 824.775101] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 824.775372] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 824.775640] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 824.775865] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-167" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.776400] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-79b4551f-549c-49a2-863e-3ad8e77312f1 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.776592] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-79b4551f-549c-49a2-863e-3ad8e77312f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.776758] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-79b4551f-549c-49a2-863e-3ad8e77312f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.777132] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-79b4551f-549c-49a2-863e-3ad8e77312f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.777272] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79b4551f-549c-49a2-863e-3ad8e77312f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.816906] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.817223] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.817291] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.817642] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.817885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.830924] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 in Status: IN_PROGRESS for 2s [ 824.859988] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.860249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.860306] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.860562] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.860690] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.860999] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.861132] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.861433] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.861680] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.861816] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.861946] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 already deleted. [ 824.862076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.280678] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.281158] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.281158] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.281289] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.281535] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.281535] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 79b4551f-549c-49a2-863e-3ad8e77312f1 not found, creating... [ 825.281806] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.281970] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.282088] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.282314] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.282443] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.282728] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.283384] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.283384] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.283384] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.283543] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.283543] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 79b4551f-549c-49a2-863e-3ad8e77312f1 is going to be created. [ 825.306678] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.306897] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.307023] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.307326] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.307552] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.307775] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-79b4551f-549c-49a2-863e-3ad8e77312f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.573821] env[65322]: INFO networking_nsxv3.common.synchronization [None req-3f00b372-29c3-4e66-9da4-2ab9d4340a1d None None] Enqueued Resource ID: b72095ab-be0b-440d-8105-166d7578b6e7 with Priority: HIGHEST for action port [ 825.574410] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b72095ab-be0b-440d-8105-166d7578b6e7 with Priority: HIGHEST for action port [ 825.574897] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-b72095ab-be0b-440d-8105-166d7578b6e7 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.574897] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b72095ab-be0b-440d-8105-166d7578b6e7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.574897] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b72095ab-be0b-440d-8105-166d7578b6e7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.575343] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b72095ab-be0b-440d-8105-166d7578b6e7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.575542] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b72095ab-be0b-440d-8105-166d7578b6e7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.036717] env[65322]: INFO networking_nsxv3.common.synchronization [req-004ba873-2b66-4135-8b08-84a51e18afd4 req-4c9958d5-c2ff-43cb-b436-52eab5e5e536 service nova] Enqueued Resource ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 with Priority: HIGHEST for action security_group_rules [ 826.037393] env[65322]: INFO networking_nsxv3.common.synchronization [req-004ba873-2b66-4135-8b08-84a51e18afd4 req-4c9958d5-c2ff-43cb-b436-52eab5e5e536 service nova] Enqueued Resource ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 with Priority: HIGHEST for action security_group_members [ 826.037393] env[65322]: INFO networking_nsxv3.common.synchronization [req-004ba873-2b66-4135-8b08-84a51e18afd4 req-4c9958d5-c2ff-43cb-b436-52eab5e5e536 service nova] Enqueued Resource ID: 79b4551f-549c-49a2-863e-3ad8e77312f1 with Priority: HIGHEST for action port [ 826.037554] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 with Priority: HIGHEST for action security_group_rules [ 826.037678] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 with Priority: HIGHEST for action security_group_members [ 826.037767] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79b4551f-549c-49a2-863e-3ad8e77312f1 with Priority: HIGHEST for action port [ 826.038095] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bf5edc0-c1b5-489c-9093-35e6cf4bd266 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.038193] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.038307] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.040016] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.040016] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bf5edc0-c1b5-489c-9093-35e6cf4bd266',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.040016] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.040016] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.040016] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.040439] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.040439] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.040439] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.040439] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.040588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.040621] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.040730] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bf5edc0-c1b5-489c-9093-35e6cf4bd266',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.041623] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-79b4551f-549c-49a2-863e-3ad8e77312f1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.041726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79b4551f-549c-49a2-863e-3ad8e77312f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.041777] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79b4551f-549c-49a2-863e-3ad8e77312f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.041924] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79b4551f-549c-49a2-863e-3ad8e77312f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.041992] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79b4551f-549c-49a2-863e-3ad8e77312f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.079118] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b72095ab-be0b-440d-8105-166d7578b6e7 [ 826.079246] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.079326] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.082692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.086422] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.086422] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.086422] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b72095ab-be0b-440d-8105-166d7578b6e7 already deleted. [ 826.086422] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b72095ab-be0b-440d-8105-166d7578b6e7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.544106] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.546087] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.546087] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7bf5edc0-c1b5-489c-9093-35e6cf4bd266',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.546087] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79b4551f-549c-49a2-863e-3ad8e77312f1 with status ACTIVE [ 826.546087] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.546087] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.546087] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.546350] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.546350] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.546411] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.546506] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.546566] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.546729] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.546796] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.546978] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.548302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.548302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.548302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.548413] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.548413] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79b4551f-549c-49a2-863e-3ad8e77312f1 is going to be updated. [ 826.573467] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.573467] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.573467] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.573467] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.573467] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.573467] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79b4551f-549c-49a2-863e-3ad8e77312f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.847641] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 in Status: SUCCESS [ 826.847641] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.050625] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7bf5edc0-c1b5-489c-9093-35e6cf4bd266',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.247231] env[65322]: INFO networking_nsxv3.common.synchronization [None req-4dea40d3-5b17-4a84-b4b9-d541479e32ae tempest-AttachVolumeTestJSON-1389790413 tempest-AttachVolumeTestJSON-1389790413-project-member] Enqueued Resource ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 with Priority: HIGHEST for action security_group_rules [ 827.247231] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 with Priority: HIGHEST for action security_group_rules [ 827.247231] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6d8499f-80cb-4c22-b03a-011aac96ea05 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.247231] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.247731] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.248686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.248686] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6d8499f-80cb-4c22-b03a-011aac96ea05',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.366168] env[65322]: INFO networking_nsxv3.common.synchronization [None req-c9805de4-d542-4d80-905d-dd6c0fb8e3bd tempest-AttachVolumeTestJSON-1389790413 tempest-AttachVolumeTestJSON-1389790413-project-member] Enqueued Resource ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 with Priority: HIGHEST for action security_group_rules [ 827.366821] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 with Priority: HIGHEST for action security_group_rules [ 827.368382] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6d8499f-80cb-4c22-b03a-011aac96ea05 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.369478] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.555190] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.555190] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.555190] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.555190] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.557797] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.557797] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 is going to be created. [ 827.587391] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.587391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.587391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.588014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.589081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.600942] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 in Status: UNINITIALIZED for 2s [ 827.776113] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.776113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.776113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.776113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.776113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.776113] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 already deleted. [ 827.776113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.776113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.776113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.776113] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6d8499f-80cb-4c22-b03a-011aac96ea05',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.198052] env[65322]: INFO networking_nsxv3.common.synchronization [None req-595101bc-4f49-424d-bfc7-68e2a135e2be None None] Enqueued Resource ID: 1880f315-b58c-4eec-8f1e-a7fe611b0dc4 with Priority: HIGHEST for action port [ 828.198515] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1880f315-b58c-4eec-8f1e-a7fe611b0dc4 with Priority: HIGHEST for action port [ 828.198832] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-1880f315-b58c-4eec-8f1e-a7fe611b0dc4 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.198946] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1880f315-b58c-4eec-8f1e-a7fe611b0dc4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.199034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1880f315-b58c-4eec-8f1e-a7fe611b0dc4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.199517] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1880f315-b58c-4eec-8f1e-a7fe611b0dc4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.199517] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1880f315-b58c-4eec-8f1e-a7fe611b0dc4',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.312589] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.312891] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.313050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.313225] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.313350] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.313624] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 already deleted. [ 828.313624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.702018] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1880f315-b58c-4eec-8f1e-a7fe611b0dc4 [ 828.702428] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.702609] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.702662] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.702875] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.703070] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.703254] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1880f315-b58c-4eec-8f1e-a7fe611b0dc4 already deleted. [ 828.703360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1880f315-b58c-4eec-8f1e-a7fe611b0dc4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.318829] env[65322]: INFO networking_nsxv3.common.synchronization [req-bcfd5573-6510-4d97-b447-1af02345f81f req-82a6ecc0-5477-4d1e-952e-5501537e0c4e tempest-ServerRescueNegativeTestJSON-325476461 tempest-ServerRescueNegativeTestJSON-325476461-project-member] Enqueued Resource ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 with Priority: HIGHEST for action security_group_members [ 829.318908] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 with Priority: HIGHEST for action security_group_members [ 829.319231] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.319333] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.613084] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-167 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.613317] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-167" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.613439] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-167" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.613710] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-167" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.613973] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.614148] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.614260] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.614488] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.614615] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.614817] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.614928] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 829.615042] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 829.615156] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 829.615253] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 829.615357] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 829.615487] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 829.618424] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 in Status: SUCCESS [ 829.618624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.618776] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.618959] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.619155] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.619284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.619344] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.619553] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.619553] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.619651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.619706] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7bf5edc0-c1b5-489c-9093-35e6cf4bd266',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.620789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.621304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.621304] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.621304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.621304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.621469] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.621503] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.621606] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bf5edc0-c1b5-489c-9093-35e6cf4bd266',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.638013] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 829.638230] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 829.638369] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 829.638560] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-167" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.640040] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-f40390da-6483-4077-9d53-edfa5cb73665 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.640040] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-f40390da-6483-4077-9d53-edfa5cb73665" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.640040] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-f40390da-6483-4077-9d53-edfa5cb73665" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.640040] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-f40390da-6483-4077-9d53-edfa5cb73665" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.640040] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f40390da-6483-4077-9d53-edfa5cb73665',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.123820] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.123820] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.124316] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7bf5edc0-c1b5-489c-9093-35e6cf4bd266',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.142881] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.143268] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.143365] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.143709] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.143866] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.144081] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port f40390da-6483-4077-9d53-edfa5cb73665 not found, creating... [ 830.144387] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.144578] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.144740] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.145722] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.145722] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.145722] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.145909] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.146088] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.146330] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.146500] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.146674] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: f40390da-6483-4077-9d53-edfa5cb73665 is going to be created. [ 830.171109] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.171437] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.171596] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.171919] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.172204] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.172488] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-f40390da-6483-4077-9d53-edfa5cb73665" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.628202] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7bf5edc0-c1b5-489c-9093-35e6cf4bd266',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.911200] env[65322]: INFO networking_nsxv3.common.synchronization [req-bcfd5573-6510-4d97-b447-1af02345f81f req-2dc82072-efbd-4969-87ee-abe624badefb service nova] Enqueued Resource ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 with Priority: HIGHEST for action security_group_rules [ 830.911329] env[65322]: INFO networking_nsxv3.common.synchronization [req-bcfd5573-6510-4d97-b447-1af02345f81f req-2dc82072-efbd-4969-87ee-abe624badefb service nova] Enqueued Resource ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 with Priority: HIGHEST for action security_group_members [ 830.911449] env[65322]: INFO networking_nsxv3.common.synchronization [req-bcfd5573-6510-4d97-b447-1af02345f81f req-2dc82072-efbd-4969-87ee-abe624badefb service nova] Enqueued Resource ID: f40390da-6483-4077-9d53-edfa5cb73665 with Priority: HIGHEST for action port [ 830.911954] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 with Priority: HIGHEST for action security_group_rules [ 830.912100] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 with Priority: HIGHEST for action security_group_members [ 830.912198] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f40390da-6483-4077-9d53-edfa5cb73665 with Priority: HIGHEST for action port [ 830.912539] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bf5edc0-c1b5-489c-9093-35e6cf4bd266 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.912539] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.912762] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.913324] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.913573] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-f40390da-6483-4077-9d53-edfa5cb73665 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.913688] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f40390da-6483-4077-9d53-edfa5cb73665" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.913756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f40390da-6483-4077-9d53-edfa5cb73665" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.914085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f40390da-6483-4077-9d53-edfa5cb73665" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.914206] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f40390da-6483-4077-9d53-edfa5cb73665',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.131567] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.132131] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.132131] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.132284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.132430] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.132608] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 is going to be updated. [ 831.168130] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.168415] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.168415] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.168691] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.168882] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.192141] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 in Status: IN_PROGRESS for 2s [ 831.417039] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f40390da-6483-4077-9d53-edfa5cb73665 with status ACTIVE [ 831.417039] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.417039] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.417269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.417391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.417461] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.417658] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.417765] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.417828] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.417976] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.418066] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.418344] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.418482] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.418540] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.418647] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.418718] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.418841] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f40390da-6483-4077-9d53-edfa5cb73665 is going to be updated. [ 831.440948] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.440948] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.440948] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.441683] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.441683] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.441683] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f40390da-6483-4077-9d53-edfa5cb73665" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.205755] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 in Status: SUCCESS [ 833.206190] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.206266] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.206531] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.206625] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.206740] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.207131] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.207314] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.207400] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.207492] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.207822] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.207883] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.207920] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.208062] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.208213] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.208321] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.208382] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.208521] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.208604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.208686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.208771] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7bf5edc0-c1b5-489c-9093-35e6cf4bd266',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.209666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.209809] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.211463] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.211463] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.211463] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.211463] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.211463] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.211463] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bf5edc0-c1b5-489c-9093-35e6cf4bd266',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.712578] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7bf5edc0-c1b5-489c-9093-35e6cf4bd266: rpc.has_security_group_logging(os_id): False [ 833.715807] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7bf5edc0-c1b5-489c-9093-35e6cf4bd266',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.731873] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.731977] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.732091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.732450] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.732598] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.732827] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.732992] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.733185] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.734070] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.735171] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.735171] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.735171] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.735171] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.735171] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.735171] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.735171] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.735458] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.735458] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.735544] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.735544] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.735664] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 is going to be created. [ 833.799124] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.799271] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.799351] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.800498] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.800498] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.812861] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 in Status: IN_PROGRESS for 2s [ 834.217604] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7bf5edc0-c1b5-489c-9093-35e6cf4bd266',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.720712] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.720906] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.720979] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.721302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.721436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.721556] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 is going to be updated. [ 834.753375] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.753551] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.753551] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.754743] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.754743] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.764587] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 in Status: IN_PROGRESS for 2s [ 835.825076] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 in Status: SUCCESS [ 835.825412] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.825525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.825754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.825848] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bf5edc0-c1b5-489c-9093-35e6cf4bd266',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.912712] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 835.912834] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 836.330297] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.330445] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.776533] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 in Status: SUCCESS [ 836.776769] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.776943] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.777479] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.777479] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.777595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.777595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.777711] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.777840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.777885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.777955] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7bf5edc0-c1b5-489c-9093-35e6cf4bd266',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.281186] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.281607] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.281607] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.281607] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.281805] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.281918] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.282629] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.282629] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.282629] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.282629] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.282629] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.282902] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.282902] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.282902] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.283044] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.283876] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.283876] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.283876] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.283876] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.283876] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.283876] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7bf5edc0-c1b5-489c-9093-35e6cf4bd266',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.786922] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7bf5edc0-c1b5-489c-9093-35e6cf4bd266: rpc.has_security_group_logging(os_id): False [ 837.805198] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.805341] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.805341] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.805601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.805653] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.805808] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.805950] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.805988] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.806125] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.806204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.806401] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.806490] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.806549] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.806689] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.806761] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.806944] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.807050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.807108] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.807275] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.807346] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.807810] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 is going to be updated. [ 837.880618] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.880618] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.880618] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.880894] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.881043] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.895878] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 in Status: IN_PROGRESS for 2s [ 839.917027] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 in Status: SUCCESS [ 839.917027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.816226] env[65322]: INFO networking_nsxv3.common.synchronization [req-680a4653-4f65-4472-b331-06dcf56b3aef req-2bee5be3-9519-4af3-8b2f-81466ff0b623 tempest-AttachVolumeShelveTestJSON-315803451 tempest-AttachVolumeShelveTestJSON-315803451-project-member] Enqueued Resource ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 with Priority: HIGHEST for action security_group_members [ 840.816879] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 with Priority: HIGHEST for action security_group_members [ 840.817788] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbf21d11-c10d-47fc-811b-f6af5267a9d6 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.818482] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.818482] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.819016] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.819361] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.819634] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.819997] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.820131] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.820638] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.820994] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbf21d11-c10d-47fc-811b-f6af5267a9d6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.323719] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.324059] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-547" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.324059] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-547" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.324482] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-547" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.324769] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.324931] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.326154] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.326466] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.326624] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.327549] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 841.328109] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 841.328109] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 841.328109] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 841.328109] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 841.328109] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 841.328307] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 841.329474] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.329550] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.329589] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.330498] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.330498] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.330498] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.330498] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.330498] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.330498] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.330498] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.331120] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 already deleted. [ 841.331120] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.352354] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 841.352532] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 841.352671] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 841.352849] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-547" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.353239] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-040e16d0-2c73-4b9c-8aec-0d70c6f20e1f taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.353413] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-040e16d0-2c73-4b9c-8aec-0d70c6f20e1f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.353532] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-040e16d0-2c73-4b9c-8aec-0d70c6f20e1f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.353862] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-040e16d0-2c73-4b9c-8aec-0d70c6f20e1f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.354016] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('040e16d0-2c73-4b9c-8aec-0d70c6f20e1f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.857539] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.857881] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.858077] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.859486] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.859486] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.859486] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 040e16d0-2c73-4b9c-8aec-0d70c6f20e1f not found, creating... [ 841.859486] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.859486] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.859486] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.859867] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.860088] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.860476] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.860666] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.860938] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.861371] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.861598] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.861833] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 040e16d0-2c73-4b9c-8aec-0d70c6f20e1f is going to be created. [ 841.888789] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.888789] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.888789] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.888789] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.888789] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.888789] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-040e16d0-2c73-4b9c-8aec-0d70c6f20e1f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.579257] env[65322]: INFO networking_nsxv3.common.synchronization [req-680a4653-4f65-4472-b331-06dcf56b3aef req-8e9c348d-5d9a-424d-a7a3-43ec22b2c447 service nova] Enqueued Resource ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 with Priority: HIGHEST for action security_group_rules [ 842.579517] env[65322]: INFO networking_nsxv3.common.synchronization [req-680a4653-4f65-4472-b331-06dcf56b3aef req-8e9c348d-5d9a-424d-a7a3-43ec22b2c447 service nova] Enqueued Resource ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 with Priority: HIGHEST for action security_group_members [ 842.579624] env[65322]: INFO networking_nsxv3.common.synchronization [req-680a4653-4f65-4472-b331-06dcf56b3aef req-8e9c348d-5d9a-424d-a7a3-43ec22b2c447 service nova] Enqueued Resource ID: 040e16d0-2c73-4b9c-8aec-0d70c6f20e1f with Priority: HIGHEST for action port [ 842.580120] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 with Priority: HIGHEST for action security_group_rules [ 842.580253] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 with Priority: HIGHEST for action security_group_members [ 842.580350] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 040e16d0-2c73-4b9c-8aec-0d70c6f20e1f with Priority: HIGHEST for action port [ 842.580614] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbf21d11-c10d-47fc-811b-f6af5267a9d6 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.580730] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.580797] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.581496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.581640] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbf21d11-c10d-47fc-811b-f6af5267a9d6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.583910] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbf21d11-c10d-47fc-811b-f6af5267a9d6 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.584318] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.584393] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.584583] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.584738] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.584834] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.584893] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.585048] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.587690] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.587690] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbf21d11-c10d-47fc-811b-f6af5267a9d6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.587690] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-040e16d0-2c73-4b9c-8aec-0d70c6f20e1f taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.587690] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-040e16d0-2c73-4b9c-8aec-0d70c6f20e1f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.587690] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-040e16d0-2c73-4b9c-8aec-0d70c6f20e1f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.587690] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-040e16d0-2c73-4b9c-8aec-0d70c6f20e1f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.587690] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('040e16d0-2c73-4b9c-8aec-0d70c6f20e1f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.084862] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbf21d11-c10d-47fc-811b-f6af5267a9d6 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.084862] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.090362] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 040e16d0-2c73-4b9c-8aec-0d70c6f20e1f with status ACTIVE [ 843.090595] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.090739] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.090810] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.091135] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.091234] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.091437] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.091540] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.091616] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.091787] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.091877] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.092119] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.092199] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.092255] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.092463] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.092553] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.092659] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 040e16d0-2c73-4b9c-8aec-0d70c6f20e1f is going to be updated. [ 843.093944] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fbf21d11-c10d-47fc-811b-f6af5267a9d6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.117610] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.117814] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.117814] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.118096] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.118243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.118480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-040e16d0-2c73-4b9c-8aec-0d70c6f20e1f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.488675] env[65322]: INFO networking_nsxv3.common.synchronization [None req-55efcc02-d5e0-48bb-9766-a63de7a3a51f None None] Enqueued Resource ID: 48aedaff-66c1-4446-b813-9cf9d16c4123 with Priority: HIGHEST for action port [ 843.491821] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48aedaff-66c1-4446-b813-9cf9d16c4123 with Priority: HIGHEST for action port [ 843.491946] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-48aedaff-66c1-4446-b813-9cf9d16c4123 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.493765] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48aedaff-66c1-4446-b813-9cf9d16c4123" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.493765] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48aedaff-66c1-4446-b813-9cf9d16c4123" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.493765] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48aedaff-66c1-4446-b813-9cf9d16c4123" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.493765] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48aedaff-66c1-4446-b813-9cf9d16c4123',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.597058] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fbf21d11-c10d-47fc-811b-f6af5267a9d6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.997796] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48aedaff-66c1-4446-b813-9cf9d16c4123 [ 843.998089] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.998293] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.999031] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.999031] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.999031] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.999031] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48aedaff-66c1-4446-b813-9cf9d16c4123 already deleted. [ 843.999354] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48aedaff-66c1-4446-b813-9cf9d16c4123" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.101017] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.101017] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.101017] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.101017] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.101017] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.101017] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 is going to be created. [ 844.128959] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.128959] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.128959] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.128959] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.128959] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.139842] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 in Status: UNINITIALIZED for 2s [ 845.771497] env[65322]: INFO networking_nsxv3.common.synchronization [None req-9274fd1f-d51d-408e-9a9e-92f53b6cc350 None None] Enqueued Resource ID: c7271a1d-336b-4180-8134-052e9ceaca9f with Priority: HIGHEST for action port [ 845.772122] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7271a1d-336b-4180-8134-052e9ceaca9f with Priority: HIGHEST for action port [ 845.772480] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7271a1d-336b-4180-8134-052e9ceaca9f taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.772642] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7271a1d-336b-4180-8134-052e9ceaca9f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.772734] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7271a1d-336b-4180-8134-052e9ceaca9f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.773065] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7271a1d-336b-4180-8134-052e9ceaca9f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.773167] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7271a1d-336b-4180-8134-052e9ceaca9f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.150739] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 in Status: SUCCESS [ 846.151024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.151139] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.151371] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.151660] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.151796] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.151861] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.152050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.152147] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.152236] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.152394] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fbf21d11-c10d-47fc-811b-f6af5267a9d6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.276229] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c7271a1d-336b-4180-8134-052e9ceaca9f [ 846.276503] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.276661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.276730] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.276978] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.277248] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.277367] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c7271a1d-336b-4180-8134-052e9ceaca9f already deleted. [ 846.277463] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7271a1d-336b-4180-8134-052e9ceaca9f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.390629] env[65322]: INFO networking_nsxv3.common.synchronization [req-24326ab4-0e85-4565-8f47-5181e49cf149 req-b8c1ef30-2e25-4908-9266-e3f1a74e050a tempest-FloatingIPsAssociationTestJSON-408950981 tempest-FloatingIPsAssociationTestJSON-408950981-project-member] Enqueued Resource ID: 739eb2bf-8f60-406e-b099-1671d90b8545 with Priority: HIGHEST for action security_group_members [ 846.391231] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 739eb2bf-8f60-406e-b099-1671d90b8545 with Priority: HIGHEST for action security_group_members [ 846.391937] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-739eb2bf-8f60-406e-b099-1671d90b8545 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.391937] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.391937] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.391937] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.392533] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.392533] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.392533] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.392533] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.392533] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.392761] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('739eb2bf-8f60-406e-b099-1671d90b8545',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.633654] env[65322]: INFO networking_nsxv3.common.synchronization [req-bd0a3388-0066-4966-9b29-97144b0b0767 req-2a60d130-c6ba-43cc-91bd-4f0116f412e3 tempest-ListImageFiltersTestJSON-1830232645 tempest-ListImageFiltersTestJSON-1830232645-project-member] Enqueued Resource ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 with Priority: HIGHEST for action security_group_members [ 846.634219] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 with Priority: HIGHEST for action security_group_members [ 846.634539] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.634680] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.634762] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.634964] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.635606] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.635717] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.635757] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.635906] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.635993] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.636101] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60b11f04-8768-43f5-bcb0-8bb51ec0bdf2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.654660] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fbf21d11-c10d-47fc-811b-f6af5267a9d6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.756802] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-798 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.757056] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-798" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.757233] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-798" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.757705] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-798" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.757773] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.757958] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.758172] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.758447] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.758654] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.758913] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 846.759274] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 846.759460] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 846.759631] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 846.759792] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 846.759971] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 846.763654] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 846.784532] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 846.784836] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 846.784893] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 846.786290] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-798" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.786290] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-6096f954-9d08-4a62-8169-9d843e866fa7 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.786290] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-6096f954-9d08-4a62-8169-9d843e866fa7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.786290] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-6096f954-9d08-4a62-8169-9d843e866fa7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.786290] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-6096f954-9d08-4a62-8169-9d843e866fa7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.786290] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6096f954-9d08-4a62-8169-9d843e866fa7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.896349] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('739eb2bf-8f60-406e-b099-1671d90b8545',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.138023] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.138178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.138267] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.138533] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.138649] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.138875] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.139053] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.139138] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.139236] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.139337] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.139433] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 is going to be updated. [ 847.158810] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fbf21d11-c10d-47fc-811b-f6af5267a9d6: rpc.has_security_group_logging(os_id): False [ 847.172964] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.173210] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.173313] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.173562] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.173748] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.182020] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.182266] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.182772] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.182772] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.182772] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.183158] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.183301] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.183396] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.183610] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.183733] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.183922] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 is going to be created. [ 847.188317] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 in Status: IN_PROGRESS for 2s [ 847.280377] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.280543] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.280583] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.280813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.280990] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.288703] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.288968] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.289069] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.289353] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.289508] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.289661] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 6096f954-9d08-4a62-8169-9d843e866fa7 not found, creating... [ 847.289924] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.290099] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.290213] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.290818] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.290818] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.291468] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.291468] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.291468] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.293419] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.293419] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.293419] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 6096f954-9d08-4a62-8169-9d843e866fa7 is going to be created. [ 847.302270] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 in Status: IN_PROGRESS for 2s [ 847.317364] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.317601] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.317724] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.318017] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.318278] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.318539] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-6096f954-9d08-4a62-8169-9d843e866fa7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.399771] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('739eb2bf-8f60-406e-b099-1671d90b8545',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.901964] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.902291] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.902291] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.902437] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.902491] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.902594] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 739eb2bf-8f60-406e-b099-1671d90b8545 is going to be updated. [ 847.934018] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.934247] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.934358] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.934651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.934869] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.944994] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 739eb2bf-8f60-406e-b099-1671d90b8545 in Status: IN_PROGRESS for 2s [ 848.018268] env[65322]: INFO networking_nsxv3.common.synchronization [req-24326ab4-0e85-4565-8f47-5181e49cf149 req-0310f115-ddca-4640-8b3d-44bafc13b6e2 service nova] Enqueued Resource ID: 739eb2bf-8f60-406e-b099-1671d90b8545 with Priority: HIGHEST for action security_group_rules [ 848.018494] env[65322]: INFO networking_nsxv3.common.synchronization [req-24326ab4-0e85-4565-8f47-5181e49cf149 req-0310f115-ddca-4640-8b3d-44bafc13b6e2 service nova] Enqueued Resource ID: 739eb2bf-8f60-406e-b099-1671d90b8545 with Priority: HIGHEST for action security_group_members [ 848.021132] env[65322]: INFO networking_nsxv3.common.synchronization [req-24326ab4-0e85-4565-8f47-5181e49cf149 req-0310f115-ddca-4640-8b3d-44bafc13b6e2 service nova] Enqueued Resource ID: 6096f954-9d08-4a62-8169-9d843e866fa7 with Priority: HIGHEST for action port [ 848.021132] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 739eb2bf-8f60-406e-b099-1671d90b8545 with Priority: HIGHEST for action security_group_rules [ 848.021132] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 739eb2bf-8f60-406e-b099-1671d90b8545 with Priority: HIGHEST for action security_group_members [ 848.021132] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6096f954-9d08-4a62-8169-9d843e866fa7 with Priority: HIGHEST for action port [ 848.021132] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-739eb2bf-8f60-406e-b099-1671d90b8545 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.021132] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.021132] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.021132] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.021132] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('739eb2bf-8f60-406e-b099-1671d90b8545',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.021628] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-739eb2bf-8f60-406e-b099-1671d90b8545 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.021628] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.022249] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-6096f954-9d08-4a62-8169-9d843e866fa7 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.022249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6096f954-9d08-4a62-8169-9d843e866fa7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.022249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6096f954-9d08-4a62-8169-9d843e866fa7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.022528] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6096f954-9d08-4a62-8169-9d843e866fa7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.022640] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6096f954-9d08-4a62-8169-9d843e866fa7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.524369] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-739eb2bf-8f60-406e-b099-1671d90b8545 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.524564] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.526126] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6096f954-9d08-4a62-8169-9d843e866fa7 with status ACTIVE [ 848.526126] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.526126] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.526126] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.526484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.526484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.528304] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.528304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.528304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.528304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.528304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.528304] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.528304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.528304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.528304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.528304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.528304] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6096f954-9d08-4a62-8169-9d843e866fa7 is going to be updated. [ 848.551736] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.551855] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.551919] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.552146] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.552277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.552439] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6096f954-9d08-4a62-8169-9d843e866fa7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.202086] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 in Status: SUCCESS [ 849.202086] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 deletion is rescheduled due to dependency. [ 849.202086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.253711] env[65322]: INFO networking_nsxv3.common.synchronization [req-9c2e49f9-8dcc-4f58-ab8a-7ebba55ee71a req-4f76e5ee-1198-4825-9acd-ce7e478c90bb tempest-ServersTestJSON-586306987 tempest-ServersTestJSON-586306987-project-member] Enqueued Resource ID: f71805db-9045-455c-ad23-3895d2f4e721 with Priority: HIGHEST for action security_group_members [ 849.257936] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f71805db-9045-455c-ad23-3895d2f4e721 with Priority: HIGHEST for action security_group_members [ 849.258847] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f71805db-9045-455c-ad23-3895d2f4e721 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.258847] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.258847] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.259222] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.259460] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.259616] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.259716] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.259974] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.260090] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.260270] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f71805db-9045-455c-ad23-3895d2f4e721',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.316892] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 in Status: SUCCESS [ 849.316892] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.662939] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-622 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.662939] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-622" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.662939] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-622" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.662939] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-622" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.662939] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.664559] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.664905] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.665244] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.665443] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.667133] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 849.667349] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 849.667512] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 849.667634] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 849.667749] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 849.667854] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 849.667992] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 849.692571] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 849.692835] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 849.692991] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 849.693304] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-622" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.693676] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-07d0422e-08d8-45fd-ab66-6e2767a74c0a taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.693886] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-07d0422e-08d8-45fd-ab66-6e2767a74c0a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.694051] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-07d0422e-08d8-45fd-ab66-6e2767a74c0a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.694403] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-07d0422e-08d8-45fd-ab66-6e2767a74c0a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.694535] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07d0422e-08d8-45fd-ab66-6e2767a74c0a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.767391] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.768070] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.768070] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.768070] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.768070] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.768347] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.768347] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.768347] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.768461] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.768461] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.768567] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f71805db-9045-455c-ad23-3895d2f4e721 already deleted. [ 849.768603] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.967306] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 739eb2bf-8f60-406e-b099-1671d90b8545 in Status: SUCCESS [ 849.967527] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.967708] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.968202] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.968202] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.968593] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.968593] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.968593] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.968593] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.968761] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('739eb2bf-8f60-406e-b099-1671d90b8545',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.197704] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.197704] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.197704] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.198145] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.198145] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.198145] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 07d0422e-08d8-45fd-ab66-6e2767a74c0a not found, creating... [ 850.198355] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.198527] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.198706] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.198856] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.198961] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.200026] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.200026] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.200026] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.200026] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.200026] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.200026] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 07d0422e-08d8-45fd-ab66-6e2767a74c0a is going to be created. [ 850.224095] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.224511] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.224613] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.224936] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.225312] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.225595] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-07d0422e-08d8-45fd-ab66-6e2767a74c0a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.447881] env[65322]: INFO networking_nsxv3.common.synchronization [req-5010c818-bf48-4fd5-aa5c-1dc82a2c4d7a req-66190570-061a-4273-9acb-a6091883bc8a tempest-ServerActionsTestOtherA-1162989957 tempest-ServerActionsTestOtherA-1162989957-project-member] Enqueued Resource ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 with Priority: HIGHEST for action security_group_members [ 850.448566] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 with Priority: HIGHEST for action security_group_members [ 850.449015] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.449126] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.449171] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.449439] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.449635] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.449726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.449800] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.449978] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.450076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.450190] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42a0bf4e-f927-429d-910f-f0fec4b5f3c8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.470694] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('739eb2bf-8f60-406e-b099-1671d90b8545',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.927797] env[65322]: INFO networking_nsxv3.common.synchronization [req-9c2e49f9-8dcc-4f58-ab8a-7ebba55ee71a req-33442b30-eef7-4981-ad77-e39403348d5a service nova] Enqueued Resource ID: f71805db-9045-455c-ad23-3895d2f4e721 with Priority: HIGHEST for action security_group_rules [ 850.927993] env[65322]: INFO networking_nsxv3.common.synchronization [req-9c2e49f9-8dcc-4f58-ab8a-7ebba55ee71a req-33442b30-eef7-4981-ad77-e39403348d5a service nova] Enqueued Resource ID: f71805db-9045-455c-ad23-3895d2f4e721 with Priority: HIGHEST for action security_group_members [ 850.928648] env[65322]: INFO networking_nsxv3.common.synchronization [req-9c2e49f9-8dcc-4f58-ab8a-7ebba55ee71a req-33442b30-eef7-4981-ad77-e39403348d5a service nova] Enqueued Resource ID: 07d0422e-08d8-45fd-ab66-6e2767a74c0a with Priority: HIGHEST for action port [ 850.928851] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f71805db-9045-455c-ad23-3895d2f4e721 with Priority: HIGHEST for action security_group_rules [ 850.928851] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f71805db-9045-455c-ad23-3895d2f4e721 with Priority: HIGHEST for action security_group_members [ 850.928941] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07d0422e-08d8-45fd-ab66-6e2767a74c0a with Priority: HIGHEST for action port [ 850.929296] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f71805db-9045-455c-ad23-3895d2f4e721 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.929396] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.929396] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.929592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.929717] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f71805db-9045-455c-ad23-3895d2f4e721',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.931038] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f71805db-9045-455c-ad23-3895d2f4e721 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.931158] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.931213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.931394] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.931544] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.931661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.931759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.931844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.931934] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.932039] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f71805db-9045-455c-ad23-3895d2f4e721',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.932843] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-07d0422e-08d8-45fd-ab66-6e2767a74c0a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.932944] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07d0422e-08d8-45fd-ab66-6e2767a74c0a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.933014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07d0422e-08d8-45fd-ab66-6e2767a74c0a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.933223] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07d0422e-08d8-45fd-ab66-6e2767a74c0a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.933305] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07d0422e-08d8-45fd-ab66-6e2767a74c0a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.953366] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.953366] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.953366] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.953779] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.953779] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.953866] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.954329] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.954329] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.954329] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.954329] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.954517] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 is going to be updated. [ 850.976490] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('739eb2bf-8f60-406e-b099-1671d90b8545',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.987478] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.987984] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.987984] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.987984] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.988191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.997690] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 in Status: IN_PROGRESS for 2s [ 851.437266] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f71805db-9045-455c-ad23-3895d2f4e721 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.437266] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.437266] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f71805db-9045-455c-ad23-3895d2f4e721',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.437266] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07d0422e-08d8-45fd-ab66-6e2767a74c0a with status ACTIVE [ 851.437266] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.437266] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.437266] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.437266] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.437266] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.438493] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.438493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.438493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.438493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.438493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.438493] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.438493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.438493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.442152] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.442152] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.442152] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07d0422e-08d8-45fd-ab66-6e2767a74c0a is going to be updated. [ 851.462975] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.463178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.463242] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.463437] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.463570] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.463727] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07d0422e-08d8-45fd-ab66-6e2767a74c0a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.478497] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.478648] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.478742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.479088] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.479088] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.479088] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 739eb2bf-8f60-406e-b099-1671d90b8545 is going to be updated. [ 851.511709] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.511907] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.511961] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.512171] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.512355] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.526744] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 739eb2bf-8f60-406e-b099-1671d90b8545 in Status: IN_PROGRESS for 2s [ 851.944110] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f71805db-9045-455c-ad23-3895d2f4e721',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.258503] env[65322]: INFO networking_nsxv3.common.synchronization [req-c29ad16d-e0a6-49c3-ba61-0c2591dd9eeb req-a5b7eed1-dd39-48bf-bbdc-584718d08b7b tempest-ServerActionsTestJSON-71326710 tempest-ServerActionsTestJSON-71326710-project-member] Enqueued Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_members [ 852.259099] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_members [ 852.259373] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.259535] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.259595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.261283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.261283] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.261283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.261283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.261283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.261283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.261283] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.446081] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.446491] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.446491] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.446617] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.446617] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.446715] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f71805db-9045-455c-ad23-3895d2f4e721 is going to be created. [ 852.472751] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.472898] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.472968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.473272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.473444] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.485957] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f71805db-9045-455c-ad23-3895d2f4e721 in Status: UNINITIALIZED for 2s [ 852.634671] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-710 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.634868] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.634988] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.635324] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.635589] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.635751] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.635865] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.639073] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.639273] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.639492] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 852.641064] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 852.641304] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 852.641365] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 852.641617] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 852.641617] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 852.641760] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 852.662597] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 852.662597] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 852.662597] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 852.662597] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.662597] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-d78b7715-2825-46bd-b3f4-40d07c12aa68 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.662597] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-d78b7715-2825-46bd-b3f4-40d07c12aa68" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.662597] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-d78b7715-2825-46bd-b3f4-40d07c12aa68" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.662597] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-d78b7715-2825-46bd-b3f4-40d07c12aa68" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.662597] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d78b7715-2825-46bd-b3f4-40d07c12aa68',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.765355] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.765541] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.765679] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.765900] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.765987] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.766200] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.766387] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.766444] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.766602] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.766678] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.766762] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d already deleted. [ 852.766839] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.012160] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 in Status: SUCCESS [ 853.012476] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 deletion is rescheduled due to dependency. [ 853.012670] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.164834] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.165105] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.165213] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.165522] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.165672] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.165823] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port d78b7715-2825-46bd-b3f4-40d07c12aa68 not found, creating... [ 853.166095] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.166272] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.166402] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.166612] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.166758] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.167099] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.167252] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.167585] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.167585] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.167706] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.167795] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: d78b7715-2825-46bd-b3f4-40d07c12aa68 is going to be created. [ 853.192520] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.192809] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.192903] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.193262] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.193605] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.193940] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-d78b7715-2825-46bd-b3f4-40d07c12aa68" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.537325] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 739eb2bf-8f60-406e-b099-1671d90b8545 in Status: SUCCESS [ 853.537325] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.538595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.538595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.538595] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.538595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.538595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.538595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.538595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.538595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.538595] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('739eb2bf-8f60-406e-b099-1671d90b8545',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.979499] env[65322]: INFO networking_nsxv3.common.synchronization [req-c29ad16d-e0a6-49c3-ba61-0c2591dd9eeb req-444cf4d3-7936-426f-a253-99436e521ddc service nova] Enqueued Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_rules [ 853.979662] env[65322]: INFO networking_nsxv3.common.synchronization [req-c29ad16d-e0a6-49c3-ba61-0c2591dd9eeb req-444cf4d3-7936-426f-a253-99436e521ddc service nova] Enqueued Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_members [ 853.979924] env[65322]: INFO networking_nsxv3.common.synchronization [req-c29ad16d-e0a6-49c3-ba61-0c2591dd9eeb req-444cf4d3-7936-426f-a253-99436e521ddc service nova] Enqueued Resource ID: d78b7715-2825-46bd-b3f4-40d07c12aa68 with Priority: HIGHEST for action port [ 853.980603] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_rules [ 853.980828] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_members [ 853.981019] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d78b7715-2825-46bd-b3f4-40d07c12aa68 with Priority: HIGHEST for action port [ 853.981467] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.981600] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.981681] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.981896] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.981987] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.982912] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.983049] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.983114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.983316] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.983481] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.983578] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.990021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.990021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.990021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.990021] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.990416] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-d78b7715-2825-46bd-b3f4-40d07c12aa68 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.990528] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d78b7715-2825-46bd-b3f4-40d07c12aa68" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.990605] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d78b7715-2825-46bd-b3f4-40d07c12aa68" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.990788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d78b7715-2825-46bd-b3f4-40d07c12aa68" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.990871] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d78b7715-2825-46bd-b3f4-40d07c12aa68',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.040754] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-739eb2bf-8f60-406e-b099-1671d90b8545 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.040754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.040754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.040912] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.041115] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.041215] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.041270] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.041425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.041511] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.041610] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.041796] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-739eb2bf-8f60-406e-b099-1671d90b8545 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.041846] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.041910] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.042066] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.042205] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.042315] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.042376] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.042512] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.042777] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.042882] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.042973] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('739eb2bf-8f60-406e-b099-1671d90b8545',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.375861] env[65322]: INFO networking_nsxv3.common.synchronization [req-928d0b5f-8973-4935-a7b4-921020ed7c95 req-861837a5-68ca-41c1-8fda-3f9df513d57a tempest-ServerDiskConfigTestJSON-1167155511 tempest-ServerDiskConfigTestJSON-1167155511-project-member] Enqueued Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 854.377161] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 854.377873] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.377873] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.378183] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.378332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.378566] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.378741] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.378846] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.379124] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.379382] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.379494] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.493697] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d78b7715-2825-46bd-b3f4-40d07c12aa68 with status ACTIVE [ 854.493996] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.494188] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.494314] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.494516] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.494609] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.494800] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.495591] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.495591] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.495591] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.495591] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.495591] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.495591] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.495591] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.496202] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.496202] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.496202] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d78b7715-2825-46bd-b3f4-40d07c12aa68 is going to be updated. [ 854.497314] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.497452] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.497922] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.502768] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f71805db-9045-455c-ad23-3895d2f4e721 in Status: SUCCESS [ 854.503108] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.503372] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.503610] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.504647] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.504811] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.504882] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.505113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.505341] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.505443] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.505869] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f71805db-9045-455c-ad23-3895d2f4e721',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.544762] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 739eb2bf-8f60-406e-b099-1671d90b8545: rpc.has_security_group_logging(os_id): False [ 854.547369] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.547561] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.547609] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.550320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.550320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.550320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d78b7715-2825-46bd-b3f4-40d07c12aa68" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.586259] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.586259] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.586259] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.586259] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.621393] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.621719] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.621863] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.621929] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.622440] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.622537] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.622933] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.622933] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.622933] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.623204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.623204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.623866] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.623959] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.624037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.624183] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.624267] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.624345] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 739eb2bf-8f60-406e-b099-1671d90b8545 is going to be updated. [ 854.765619] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.765619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.765619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.766035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.766035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.791677] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 739eb2bf-8f60-406e-b099-1671d90b8545 in Status: IN_PROGRESS for 2s [ 854.882206] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.882206] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.882206] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.882485] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.882525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.883414] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.883414] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.883414] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.883777] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.883777] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.883777] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 is going to be deleted. [ 854.899867] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-173 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.900084] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-173" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.900187] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-173" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.900458] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-173" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.900718] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.900870] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.900983] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.901296] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.901446] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.901661] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 854.905028] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 854.905028] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 854.905028] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 854.905028] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 854.905028] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 854.905028] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 854.934452] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 854.934452] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 854.934452] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 854.934452] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-173" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.934452] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-59b9f40b-fa5d-4d50-aff2-c09140a57319 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.934452] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-59b9f40b-fa5d-4d50-aff2-c09140a57319" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.935243] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-59b9f40b-fa5d-4d50-aff2-c09140a57319" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.936085] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-59b9f40b-fa5d-4d50-aff2-c09140a57319" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.937012] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59b9f40b-fa5d-4d50-aff2-c09140a57319',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.939110] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.939507] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.939667] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.940557] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.941274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.941274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.002627] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.007248] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f71805db-9045-455c-ad23-3895d2f4e721',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.442888] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.443554] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.443831] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.444233] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.444500] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.445274] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 59b9f40b-fa5d-4d50-aff2-c09140a57319 not found, creating... [ 855.445274] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.445274] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.445446] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.446187] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.446187] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.446187] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.446383] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.446421] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.446616] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.446749] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.446886] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 59b9f40b-fa5d-4d50-aff2-c09140a57319 is going to be created. [ 855.470934] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.470934] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.470934] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.470934] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.471355] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.471442] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-59b9f40b-fa5d-4d50-aff2-c09140a57319" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.505173] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.505350] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.505419] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.505717] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.505826] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.505951] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d is going to be created. [ 855.508999] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f71805db-9045-455c-ad23-3895d2f4e721: rpc.has_security_group_logging(os_id): False [ 855.542386] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.542588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.542640] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.542827] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.542927] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.543335] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.543412] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.543484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.543704] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.543792] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.543879] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f71805db-9045-455c-ad23-3895d2f4e721 is going to be created. [ 855.547864] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.548234] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.548234] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.548328] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.548468] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.559592] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: UNINITIALIZED for 2s [ 855.700804] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.700804] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.701221] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.701221] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.701322] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.719760] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f71805db-9045-455c-ad23-3895d2f4e721 in Status: IN_PROGRESS for 2s [ 856.257982] env[65322]: INFO networking_nsxv3.common.synchronization [req-928d0b5f-8973-4935-a7b4-921020ed7c95 req-7be4522c-30df-4b47-b6c5-6ca1607807c9 service nova] Enqueued Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_rules [ 856.257982] env[65322]: INFO networking_nsxv3.common.synchronization [req-928d0b5f-8973-4935-a7b4-921020ed7c95 req-7be4522c-30df-4b47-b6c5-6ca1607807c9 service nova] Enqueued Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 856.257982] env[65322]: INFO networking_nsxv3.common.synchronization [req-928d0b5f-8973-4935-a7b4-921020ed7c95 req-7be4522c-30df-4b47-b6c5-6ca1607807c9 service nova] Enqueued Resource ID: 59b9f40b-fa5d-4d50-aff2-c09140a57319 with Priority: HIGHEST for action port [ 856.257982] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_rules [ 856.257982] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 856.257982] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59b9f40b-fa5d-4d50-aff2-c09140a57319 with Priority: HIGHEST for action port [ 856.258561] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.258561] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.258561] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.258561] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.258561] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.260245] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.260245] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.260245] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.260245] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.260245] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.260245] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.260245] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.260245] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.260669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.260669] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.261349] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-59b9f40b-fa5d-4d50-aff2-c09140a57319 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.261515] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59b9f40b-fa5d-4d50-aff2-c09140a57319" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.261515] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59b9f40b-fa5d-4d50-aff2-c09140a57319" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.262659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59b9f40b-fa5d-4d50-aff2-c09140a57319" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.262659] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59b9f40b-fa5d-4d50-aff2-c09140a57319',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.763374] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.763374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.764596] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.765914] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 59b9f40b-fa5d-4d50-aff2-c09140a57319 with status ACTIVE [ 856.765914] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.765914] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.766409] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.766409] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.766409] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.766610] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.766610] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.766610] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.766767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.766841] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.767029] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.767156] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.767237] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.767373] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.767541] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.767597] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 59b9f40b-fa5d-4d50-aff2-c09140a57319 is going to be updated. [ 856.791813] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.791813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.791813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.791813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.791813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.791813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59b9f40b-fa5d-4d50-aff2-c09140a57319" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.808866] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 739eb2bf-8f60-406e-b099-1671d90b8545 in Status: SUCCESS [ 856.809123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.966053] env[65322]: INFO networking_nsxv3.common.synchronization [req-fbb63aab-5b56-47c8-a668-e1bd391c7c2f req-b221b0d4-c8cb-47a8-89d1-a227b6bf2600 tempest-ListServerFiltersTestJSON-548115459 tempest-ListServerFiltersTestJSON-548115459-project-member] Enqueued Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGHEST for action security_group_members [ 856.966053] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGHEST for action security_group_members [ 856.966053] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.966053] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.966053] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.966690] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.966987] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.967240] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.967399] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.967673] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.967915] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.968129] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.271047] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.372371] env[65322]: INFO networking_nsxv3.common.synchronization [req-8e5972a6-b9da-4961-93a6-c15342658c13 req-ccd86eac-0bd2-43a0-a8de-b394516d1e1f tempest-ImagesOneServerNegativeTestJSON-1972759635 tempest-ImagesOneServerNegativeTestJSON-1972759635-project-member] Enqueued Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGHEST for action security_group_members [ 857.372759] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGHEST for action security_group_members [ 857.373379] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1550bb0-c88b-4864-824e-b80ca3b52834 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.373552] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.373552] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.375114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.375114] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.375114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.375114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.375114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.375114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.375114] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.469941] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.573070] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: SUCCESS [ 857.573070] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.573070] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.573070] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.573415] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.573415] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.573415] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.573632] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.573632] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.573707] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.573905] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.733994] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f71805db-9045-455c-ad23-3895d2f4e721 in Status: SUCCESS [ 857.734308] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.773290] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.773857] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.773857] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.773857] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.774243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.774243] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 is going to be created. [ 857.799940] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-139 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.800172] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-139" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.800295] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-139" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.800600] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-139" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.800841] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.800991] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.801242] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.801451] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.801626] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.801905] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 857.801977] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 857.802029] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 857.802134] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 857.802238] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 857.802343] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 857.802469] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 857.804249] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.804501] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.804501] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.804607] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.805937] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.819862] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: UNINITIALIZED for 2s [ 857.832583] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 857.832583] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 857.832583] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 857.832583] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-139" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.832865] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-4b5cfeb4-c122-471d-ba0d-c083847e6401 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.832946] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-4b5cfeb4-c122-471d-ba0d-c083847e6401" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.833096] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-4b5cfeb4-c122-471d-ba0d-c083847e6401" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.834425] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-4b5cfeb4-c122-471d-ba0d-c083847e6401" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.834425] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b5cfeb4-c122-471d-ba0d-c083847e6401',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.877736] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.877938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.877938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.878131] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.878469] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.878810] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.879374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.879374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.879374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.879374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.879594] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1550bb0-c88b-4864-824e-b80ca3b52834 is going to be deleted. [ 857.909357] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.909548] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.909623] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.909834] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.909922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.910031] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.972339] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.078190] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.337607] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.337855] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.337972] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.338375] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.338501] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.338613] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 4b5cfeb4-c122-471d-ba0d-c083847e6401 not found, creating... [ 858.338882] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.339129] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.339297] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.339540] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.339656] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.339932] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.340093] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.340210] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.340788] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.340788] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.340788] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 4b5cfeb4-c122-471d-ba0d-c083847e6401 is going to be created. [ 858.365108] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.365428] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.365610] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.365949] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.366200] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.366420] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-4b5cfeb4-c122-471d-ba0d-c083847e6401" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.477216] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.477216] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.477216] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.477216] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.477216] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.477216] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eae2009-1124-44b2-a496-3582997767b0 is going to be updated. [ 858.530454] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.530761] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.530761] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.530869] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.532139] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.543832] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eae2009-1124-44b2-a496-3582997767b0 in Status: IN_PROGRESS for 2s [ 858.581706] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d: rpc.has_security_group_logging(os_id): False [ 858.621695] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.621973] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.622056] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.622273] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.622355] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.622685] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.622784] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.622846] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.622996] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.623129] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.623227] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d is going to be created. [ 858.713248] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.713248] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.713248] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.713248] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.713503] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.726395] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: IN_PROGRESS for 2s [ 859.185568] env[65322]: INFO networking_nsxv3.common.synchronization [req-8e5972a6-b9da-4961-93a6-c15342658c13 req-3bf0fb0d-5062-4871-b894-e629e098d72e service nova] Enqueued Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGHEST for action security_group_rules [ 859.185904] env[65322]: INFO networking_nsxv3.common.synchronization [req-8e5972a6-b9da-4961-93a6-c15342658c13 req-3bf0fb0d-5062-4871-b894-e629e098d72e service nova] Enqueued Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGHEST for action security_group_members [ 859.186154] env[65322]: INFO networking_nsxv3.common.synchronization [req-8e5972a6-b9da-4961-93a6-c15342658c13 req-3bf0fb0d-5062-4871-b894-e629e098d72e service nova] Enqueued Resource ID: 4b5cfeb4-c122-471d-ba0d-c083847e6401 with Priority: HIGHEST for action port [ 859.186983] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGHEST for action security_group_rules [ 859.187154] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGHEST for action security_group_members [ 859.187232] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b5cfeb4-c122-471d-ba0d-c083847e6401 with Priority: HIGHEST for action port [ 859.187578] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1550bb0-c88b-4864-824e-b80ca3b52834 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.187766] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.187886] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.188263] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.188326] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.189868] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1550bb0-c88b-4864-824e-b80ca3b52834 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.189981] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.190067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.190273] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.190402] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.190498] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.190559] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.191558] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.191558] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.191558] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.191713] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b5cfeb4-c122-471d-ba0d-c083847e6401 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.192048] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b5cfeb4-c122-471d-ba0d-c083847e6401" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.192048] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b5cfeb4-c122-471d-ba0d-c083847e6401" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.192048] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b5cfeb4-c122-471d-ba0d-c083847e6401" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.192217] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b5cfeb4-c122-471d-ba0d-c083847e6401',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.694842] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1550bb0-c88b-4864-824e-b80ca3b52834 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.695176] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.695237] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b5cfeb4-c122-471d-ba0d-c083847e6401 with status ACTIVE [ 859.695430] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.695822] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.695822] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.696143] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.696254] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.696434] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.696534] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.696609] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.696757] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.696825] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.697016] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.697119] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.697181] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.697315] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.697379] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.697462] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b5cfeb4-c122-471d-ba0d-c083847e6401 is going to be updated. [ 859.698800] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.721190] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.721411] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.721461] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.721705] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.721866] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.722043] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b5cfeb4-c122-471d-ba0d-c083847e6401" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.835923] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: SUCCESS [ 859.836161] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.836340] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.837761] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.837761] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.837761] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.837761] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.837761] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.837761] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.837761] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.837761] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.203236] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.339599] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.340383] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.340503] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.340935] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.341207] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.341375] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.341480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.341719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.341855] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.342011] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.344477] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.344697] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.345650] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.345939] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.346219] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.346531] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.347375] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.347601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.347737] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.347882] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.348042] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.559649] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eae2009-1124-44b2-a496-3582997767b0 in Status: SUCCESS [ 860.560091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.704419] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.705821] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.705821] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.705821] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.705821] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.705821] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1550bb0-c88b-4864-824e-b80ca3b52834 is going to be created. [ 860.738878] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: SUCCESS [ 860.740554] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.742512] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.742665] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.742738] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.742958] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.743137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.753084] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1550bb0-c88b-4864-824e-b80ca3b52834 in Status: UNINITIALIZED for 2s [ 860.851884] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a34cfbc5-e3ce-4943-8058-702a82703915: rpc.has_security_group_logging(os_id): False [ 860.880268] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.880472] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.880565] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.880807] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.880899] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.881198] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.881293] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.881361] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.881520] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.881593] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.881835] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.881929] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.881992] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.882182] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.882402] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.882498] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.882498] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.882612] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.882724] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.882792] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.882878] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 is going to be created. [ 860.961444] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.961695] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.961695] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.963548] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.963548] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.980343] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: IN_PROGRESS for 2s [ 862.768695] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1550bb0-c88b-4864-824e-b80ca3b52834 in Status: SUCCESS [ 862.769217] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.769217] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.769370] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.769568] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.769776] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.769776] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.769926] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.769989] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.770069] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.770172] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.994777] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: SUCCESS [ 862.994958] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.273585] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1550bb0-c88b-4864-824e-b80ca3b52834 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.273791] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.273791] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.274035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.274199] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.274382] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.274516] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.274606] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.274671] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.274745] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.274864] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1550bb0-c88b-4864-824e-b80ca3b52834 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.274951] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.275037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.275190] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.275326] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.275412] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.275474] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.275595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.275660] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.275760] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.275821] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.777911] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1550bb0-c88b-4864-824e-b80ca3b52834: rpc.has_security_group_logging(os_id): False [ 863.797692] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.797968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.797968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.798138] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.798230] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.798470] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.798551] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.798601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.798751] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.798827] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.799021] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.799110] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.799172] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.799312] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.799386] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.799559] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.799648] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.799709] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.799844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.799916] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.799999] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1550bb0-c88b-4864-824e-b80ca3b52834 is going to be created. [ 863.876491] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.877186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.877300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.877568] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.878131] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.893478] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1550bb0-c88b-4864-824e-b80ca3b52834 in Status: IN_PROGRESS for 2s [ 863.967233] env[65322]: INFO networking_nsxv3.common.synchronization [req-f68120cc-eb9b-412a-8fd9-56a4b436f571 req-b41e058b-13d4-4945-9270-8b14157eceb4 tempest-ServersNegativeTestJSON-1020115219 tempest-ServersNegativeTestJSON-1020115219-project-member] Enqueued Resource ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 with Priority: HIGHEST for action security_group_members [ 863.967887] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 with Priority: HIGHEST for action security_group_members [ 863.969093] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.969093] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.969240] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.969473] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.969635] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.969783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.969991] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.970175] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.970264] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.970365] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.363381] env[65322]: INFO networking_nsxv3.common.synchronization [req-367d02db-cf5e-403b-9858-df31d34bce59 req-ca33e6d8-add0-4728-a75c-15ee8250cac0 tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 864.363658] env[65322]: INFO networking_nsxv3.common.synchronization [req-367d02db-cf5e-403b-9858-df31d34bce59 req-ca33e6d8-add0-4728-a75c-15ee8250cac0 tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 506e677b-3a46-4740-8e93-f6dcf6d18933 with Priority: HIGHEST for action security_group_members [ 864.364472] env[65322]: INFO networking_nsxv3.common.synchronization [req-367d02db-cf5e-403b-9858-df31d34bce59 req-ca33e6d8-add0-4728-a75c-15ee8250cac0 tempest-SecurityGroupsTestJSON-947253623 tempest-SecurityGroupsTestJSON-947253623-project-member] Enqueued Resource ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb with Priority: HIGHEST for action security_group_members [ 864.364472] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGHEST for action security_group_members [ 864.364472] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 506e677b-3a46-4740-8e93-f6dcf6d18933 with Priority: HIGHEST for action security_group_members [ 864.364720] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb with Priority: HIGHEST for action security_group_members [ 864.365085] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.365241] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.365290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.365623] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.365623] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.365815] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.365815] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.366337] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.366337] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.366337] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.367802] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-506e677b-3a46-4740-8e93-f6dcf6d18933 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.367942] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-506e677b-3a46-4740-8e93-f6dcf6d18933" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.367991] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-506e677b-3a46-4740-8e93-f6dcf6d18933" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.369010] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-506e677b-3a46-4740-8e93-f6dcf6d18933" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.369010] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.369010] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.369010] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.369010] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.369010] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.369010] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('506e677b-3a46-4740-8e93-f6dcf6d18933',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.369870] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-08f780ea-bce2-462d-b3b7-63ec1260a6bb taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.370082] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.370082] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.370219] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.370367] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.370482] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.370535] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.370650] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.370731] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.371164] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08f780ea-bce2-462d-b3b7-63ec1260a6bb',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.474568] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.475103] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.475328] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.475702] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.475880] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.476461] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.479493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.479493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.479493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.479493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.479493] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 already deleted. [ 864.479493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.621592] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.622367] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-517" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.624409] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-517" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.625948] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-517" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.626282] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.626461] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.626582] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.626852] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.626995] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.627218] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 864.627327] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 864.627433] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 864.627534] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 864.627636] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 864.627738] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 864.627869] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 864.653320] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 864.653563] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 864.653715] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 864.653895] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-517" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.655304] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-2b363d62-2c70-46b4-a76f-17a259a92979 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.655304] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-2b363d62-2c70-46b4-a76f-17a259a92979" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.655304] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-2b363d62-2c70-46b4-a76f-17a259a92979" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.655304] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-2b363d62-2c70-46b4-a76f-17a259a92979" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.655629] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b363d62-2c70-46b4-a76f-17a259a92979',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.872664] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.873024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.873024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.873162] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.874306] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.874411] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.874669] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.874754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.895613] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.895875] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.895999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.896069] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.896262] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.896339] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.896429] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 506e677b-3a46-4740-8e93-f6dcf6d18933 is going to be updated. [ 864.901021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.901021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.901021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.901021] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.901021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.901021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.901021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.901021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.901021] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e65996f-05e7-4178-bdb9-30270bc56380 is going to be updated. [ 864.901021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.901021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.920341] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.920593] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.920712] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.920779] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.920972] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.921069] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.921161] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb is going to be updated. [ 864.944981] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.945184] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.945243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.945531] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.945675] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.954751] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.954751] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.954751] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.954751] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.954751] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.957282] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: IN_PROGRESS for 2s [ 864.966200] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 506e677b-3a46-4740-8e93-f6dcf6d18933 in Status: IN_PROGRESS for 2s [ 864.975519] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.975677] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.976108] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.976108] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.976222] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.988643] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb in Status: IN_PROGRESS for 2s [ 865.158617] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.158917] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.159131] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.159607] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.159798] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.160010] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 2b363d62-2c70-46b4-a76f-17a259a92979 not found, creating... [ 865.160390] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.160608] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.160960] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.161169] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.161363] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.161748] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.161961] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.162229] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.162423] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.162843] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.162843] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 2b363d62-2c70-46b4-a76f-17a259a92979 is going to be created. [ 865.207687] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.207975] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.208076] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.208349] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.208606] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.208924] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-2b363d62-2c70-46b4-a76f-17a259a92979" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.906799] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1550bb0-c88b-4864-824e-b80ca3b52834 in Status: SUCCESS [ 865.907171] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.913586] env[65322]: INFO networking_nsxv3.common.synchronization [req-f68120cc-eb9b-412a-8fd9-56a4b436f571 req-1940f7e9-ddc4-46c6-b3b6-55018d9e651e service nova] Enqueued Resource ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 with Priority: HIGHEST for action security_group_rules [ 865.913911] env[65322]: INFO networking_nsxv3.common.synchronization [req-f68120cc-eb9b-412a-8fd9-56a4b436f571 req-1940f7e9-ddc4-46c6-b3b6-55018d9e651e service nova] Enqueued Resource ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 with Priority: HIGHEST for action security_group_members [ 865.914054] env[65322]: INFO networking_nsxv3.common.synchronization [req-f68120cc-eb9b-412a-8fd9-56a4b436f571 req-1940f7e9-ddc4-46c6-b3b6-55018d9e651e service nova] Enqueued Resource ID: 2b363d62-2c70-46b4-a76f-17a259a92979 with Priority: HIGHEST for action port [ 865.914674] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 with Priority: HIGHEST for action security_group_rules [ 865.914834] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 with Priority: HIGHEST for action security_group_members [ 865.914937] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b363d62-2c70-46b4-a76f-17a259a92979 with Priority: HIGHEST for action port [ 865.915354] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d8cdb67-7719-40d5-8ef7-63d3e76937f0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.915488] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.915552] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.915843] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.915937] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.917290] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.917411] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.917476] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.917796] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.917962] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.918091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.918134] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.918277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.918361] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.918452] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.919768] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b363d62-2c70-46b4-a76f-17a259a92979 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.919887] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b363d62-2c70-46b4-a76f-17a259a92979" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.919954] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b363d62-2c70-46b4-a76f-17a259a92979" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.920151] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b363d62-2c70-46b4-a76f-17a259a92979" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.920228] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b363d62-2c70-46b4-a76f-17a259a92979',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.421893] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.422942] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.423133] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.424415] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b363d62-2c70-46b4-a76f-17a259a92979 with status ACTIVE [ 866.424582] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.424700] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.424829] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.424975] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.425077] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.425254] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.425348] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.425469] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.425549] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.425644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.425840] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.425946] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.426147] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.426188] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.426226] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.426307] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b363d62-2c70-46b4-a76f-17a259a92979 is going to be updated. [ 866.451051] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.451279] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.451377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.451596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.451727] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.451889] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b363d62-2c70-46b4-a76f-17a259a92979" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.819219] env[65322]: INFO networking_nsxv3.common.synchronization [req-1f214bab-9da1-4923-a28b-88f7cd575885 req-1cb1a492-67d5-43fa-a8de-3dc21552a5c1 tempest-ServersAdminTestJSON-1989503110 tempest-ServersAdminTestJSON-1989503110-project-member] Enqueued Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_members [ 866.819219] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_members [ 866.819219] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.819219] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.819219] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.819219] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.819219] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.820478] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.820719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.821430] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.821655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.821889] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.931079] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.969213] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e65996f-05e7-4178-bdb9-30270bc56380 in Status: SUCCESS [ 866.969509] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e65996f-05e7-4178-bdb9-30270bc56380 deletion is rescheduled due to dependency. [ 866.969661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.974742] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 506e677b-3a46-4740-8e93-f6dcf6d18933 in Status: SUCCESS [ 866.974935] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 506e677b-3a46-4740-8e93-f6dcf6d18933 deletion is rescheduled due to dependency. [ 866.975311] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-506e677b-3a46-4740-8e93-f6dcf6d18933" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.999738] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb in Status: SUCCESS [ 866.999937] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08f780ea-bce2-462d-b3b7-63ec1260a6bb deletion is rescheduled due to dependency. [ 867.000069] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08f780ea-bce2-462d-b3b7-63ec1260a6bb" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.239032] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-174 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.240018] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-174" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.240018] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-174" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.240018] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-174" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.240899] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.241117] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.241242] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.241498] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.241644] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.241852] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 867.241962] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 867.242079] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 867.242186] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 867.242304] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 867.242382] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 867.242509] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 867.262391] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 867.262552] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 867.262693] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 867.263365] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-174" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.263882] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-0e8d4c80-ceb1-4f0a-99af-80a518945edd taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.264177] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-0e8d4c80-ceb1-4f0a-99af-80a518945edd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.264340] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-0e8d4c80-ceb1-4f0a-99af-80a518945edd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.265294] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-0e8d4c80-ceb1-4f0a-99af-80a518945edd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.265365] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e8d4c80-ceb1-4f0a-99af-80a518945edd',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.324818] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.438042] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.438042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.438042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.438399] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.438399] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.438533] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 is going to be created. [ 867.467967] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.468193] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.468193] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.468616] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.468616] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.483796] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 in Status: UNINITIALIZED for 2s [ 867.768666] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.768987] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.769170] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.769565] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.769720] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.769927] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 0e8d4c80-ceb1-4f0a-99af-80a518945edd not found, creating... [ 867.770293] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.770515] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.770690] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.770992] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.771206] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.771573] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.771777] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.771932] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.772224] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.772399] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.772586] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 0e8d4c80-ceb1-4f0a-99af-80a518945edd is going to be created. [ 867.798981] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.799220] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.799344] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.799630] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.799860] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.800148] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-0e8d4c80-ceb1-4f0a-99af-80a518945edd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.828018] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.331059] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.331059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.331059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.331614] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.331614] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.331614] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 is going to be updated. [ 868.372615] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.372806] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.372853] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.373064] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.373215] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.386879] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: IN_PROGRESS for 2s [ 868.570674] env[65322]: INFO networking_nsxv3.common.synchronization [req-1f214bab-9da1-4923-a28b-88f7cd575885 req-51622bc9-3b95-45ab-b10f-21f00db1b14c service nova] Enqueued Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_rules [ 868.570674] env[65322]: INFO networking_nsxv3.common.synchronization [req-1f214bab-9da1-4923-a28b-88f7cd575885 req-51622bc9-3b95-45ab-b10f-21f00db1b14c service nova] Enqueued Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_members [ 868.570674] env[65322]: INFO networking_nsxv3.common.synchronization [req-1f214bab-9da1-4923-a28b-88f7cd575885 req-51622bc9-3b95-45ab-b10f-21f00db1b14c service nova] Enqueued Resource ID: 0e8d4c80-ceb1-4f0a-99af-80a518945edd with Priority: HIGHEST for action port [ 868.571038] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_rules [ 868.571749] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_members [ 868.571749] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e8d4c80-ceb1-4f0a-99af-80a518945edd with Priority: HIGHEST for action port [ 868.571749] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.571749] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.572068] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.572068] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.572068] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.572902] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.572989] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.575245] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e8d4c80-ceb1-4f0a-99af-80a518945edd taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.575245] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e8d4c80-ceb1-4f0a-99af-80a518945edd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.575245] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e8d4c80-ceb1-4f0a-99af-80a518945edd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.575245] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e8d4c80-ceb1-4f0a-99af-80a518945edd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.575245] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e8d4c80-ceb1-4f0a-99af-80a518945edd',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.077055] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.077055] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.077055] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e8d4c80-ceb1-4f0a-99af-80a518945edd with status ACTIVE [ 869.077270] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.077270] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.077429] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.077577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.077760] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.077882] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.077975] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.078052] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.078212] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.078289] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.078482] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.078611] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.078677] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.079382] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.081022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.081022] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e8d4c80-ceb1-4f0a-99af-80a518945edd is going to be updated. [ 869.104787] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.105115] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.105115] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.105230] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.105942] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.105942] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e8d4c80-ceb1-4f0a-99af-80a518945edd" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.494573] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 in Status: SUCCESS [ 869.495076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.495076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.495267] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.495456] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.495619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.495619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.495863] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.495960] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.496052] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.496140] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.568086] env[65322]: INFO networking_nsxv3.common.synchronization [req-45055e3a-0240-43f4-8781-f119a17a8795 req-ee9c4a78-6df9-4b6a-a90c-ad4174bcf953 tempest-FloatingIPsAssociationTestJSON-408950981 tempest-FloatingIPsAssociationTestJSON-408950981-project-member] Enqueued Resource ID: 739eb2bf-8f60-406e-b099-1671d90b8545 with Priority: HIGHEST for action security_group_members [ 869.568343] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 739eb2bf-8f60-406e-b099-1671d90b8545 with Priority: HIGHEST for action security_group_members [ 869.568956] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-739eb2bf-8f60-406e-b099-1671d90b8545 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.569963] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.570074] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.574311] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.574580] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.574771] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.574853] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.575050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.575142] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.575246] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('739eb2bf-8f60-406e-b099-1671d90b8545',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.998206] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.998383] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.998429] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.998785] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.998870] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.998951] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.999009] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.999138] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.999252] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.999353] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.999508] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.999610] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.999673] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.999800] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.999932] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.000031] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.000092] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.000230] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.000316] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.000366] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.000457] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.078545] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('739eb2bf-8f60-406e-b099-1671d90b8545',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.399596] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: SUCCESS [ 870.400632] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.400864] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.401096] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.401378] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.401591] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.401591] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.401765] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.401858] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.401982] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.509624] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d8cdb67-7719-40d5-8ef7-63d3e76937f0: rpc.has_security_group_logging(os_id): False [ 870.529119] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.530783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.530783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.530783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.530783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.530783] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.530783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.530783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.530783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.530783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.530783] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.530783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.531608] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.531608] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.531608] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.531608] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.531608] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.531608] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.531875] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.531875] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.531875] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 is going to be created. [ 870.583930] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('739eb2bf-8f60-406e-b099-1671d90b8545',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.636180] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.639085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.639085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.639085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.639085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.658585] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 in Status: IN_PROGRESS for 2s [ 870.908912] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.086533] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.086533] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.086533] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.086802] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.086802] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.086897] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 739eb2bf-8f60-406e-b099-1671d90b8545 is going to be updated. [ 871.122180] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.122396] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.122840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.122840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.122840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.138345] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 739eb2bf-8f60-406e-b099-1671d90b8545 in Status: IN_PROGRESS for 2s [ 871.411709] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.849459] env[65322]: INFO networking_nsxv3.common.synchronization [None req-117ec9a7-1aa0-49ab-a0af-b66d798d9e5e tempest-ServerRescueNegativeTestJSON-325476461 tempest-ServerRescueNegativeTestJSON-325476461-project-member] Enqueued Resource ID: 429d42d7-e5e7-4ade-9c7f-c5151648e98f with Priority: HIGHEST for action security_group_rules [ 871.851800] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 429d42d7-e5e7-4ade-9c7f-c5151648e98f with Priority: HIGHEST for action security_group_rules [ 871.853191] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-429d42d7-e5e7-4ade-9c7f-c5151648e98f taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.853861] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.854062] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.854407] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.854579] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('429d42d7-e5e7-4ade-9c7f-c5151648e98f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.914797] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.915059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.915471] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.915767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.915875] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.915983] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 is going to be updated. [ 871.937225] env[65322]: INFO networking_nsxv3.common.synchronization [None req-91b6e979-25e4-4859-bed1-7ec625434e06 tempest-ServerRescueNegativeTestJSON-325476461 tempest-ServerRescueNegativeTestJSON-325476461-project-member] Enqueued Resource ID: 429d42d7-e5e7-4ade-9c7f-c5151648e98f with Priority: HIGHEST for action security_group_rules [ 871.937646] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 429d42d7-e5e7-4ade-9c7f-c5151648e98f with Priority: HIGHEST for action security_group_rules [ 871.938417] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-429d42d7-e5e7-4ade-9c7f-c5151648e98f taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.938713] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.949117] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.949346] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.949346] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.949597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.950204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.959437] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: IN_PROGRESS for 2s [ 872.379582] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.382249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.382249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.382249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.382249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.382249] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 429d42d7-e5e7-4ade-9c7f-c5151648e98f already deleted. [ 872.382249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.382249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.382249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.382249] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('429d42d7-e5e7-4ade-9c7f-c5151648e98f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.673327] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 in Status: SUCCESS [ 872.673732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.860616] env[65322]: INFO networking_nsxv3.common.synchronization [req-bd4253ca-9799-4249-bc4c-a4e9e76235ad req-deb89bc9-8bb1-402c-ba9f-74e78eba8edc tempest-ServersAdminNegativeTestJSON-636642581 tempest-ServersAdminNegativeTestJSON-636642581-project-member] Enqueued Resource ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 with Priority: HIGHEST for action security_group_members [ 872.861143] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 with Priority: HIGHEST for action security_group_members [ 872.861565] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-dae95ed3-e249-4093-bc1a-6e3471cc5953 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.861723] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.861836] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.862213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.862415] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.862547] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.862619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.862825] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.862869] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.862974] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dae95ed3-e249-4093-bc1a-6e3471cc5953',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.915369] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.915592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.915592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.916052] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.916052] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.916052] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 429d42d7-e5e7-4ade-9c7f-c5151648e98f already deleted. [ 872.918335] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.150499] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 739eb2bf-8f60-406e-b099-1671d90b8545 in Status: SUCCESS [ 873.150849] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.298661] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-620 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.298858] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.298981] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.299273] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.299536] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.299688] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.299799] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.300015] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.300376] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.300589] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 873.300701] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 873.300805] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 873.300908] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 873.301030] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 873.301137] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 873.301299] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 873.321008] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 873.321203] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 873.321408] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 873.321605] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.321921] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-ac500d91-71bd-4647-9d99-2e8682b717ad taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.322102] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-ac500d91-71bd-4647-9d99-2e8682b717ad" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.322219] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-ac500d91-71bd-4647-9d99-2e8682b717ad" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.322544] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-ac500d91-71bd-4647-9d99-2e8682b717ad" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.322679] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac500d91-71bd-4647-9d99-2e8682b717ad',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.365970] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.366159] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.366240] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.366436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.366552] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.366717] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.366811] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.366873] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.367023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.367100] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.367214] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 already deleted. [ 873.367262] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.825140] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.828232] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.828232] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.828232] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.828232] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.828232] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port ac500d91-71bd-4647-9d99-2e8682b717ad not found, creating... [ 873.828232] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.828232] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.828232] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.828232] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.828232] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.828726] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.828726] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.828726] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.828726] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.828726] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.828971] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: ac500d91-71bd-4647-9d99-2e8682b717ad is going to be created. [ 873.856223] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.856500] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.856581] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.856874] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.857114] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.857341] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-ac500d91-71bd-4647-9d99-2e8682b717ad" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.970996] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: SUCCESS [ 873.971321] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.971484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.971725] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.971921] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.972057] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.972125] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.972291] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.972374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.972506] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.972552] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.475512] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.475675] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.475734] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.475999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.476171] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.476277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.476343] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.476496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.476585] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.476692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.476812] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.477089] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.477089] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.477220] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.477260] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.477320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.477381] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.477514] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.477585] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.477665] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.477752] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.599881] env[65322]: INFO networking_nsxv3.common.synchronization [req-bd4253ca-9799-4249-bc4c-a4e9e76235ad req-9b1de237-138e-404f-9f6a-5c689dba2ca8 service nova] Enqueued Resource ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 with Priority: HIGHEST for action security_group_rules [ 874.600066] env[65322]: INFO networking_nsxv3.common.synchronization [req-bd4253ca-9799-4249-bc4c-a4e9e76235ad req-9b1de237-138e-404f-9f6a-5c689dba2ca8 service nova] Enqueued Resource ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 with Priority: HIGHEST for action security_group_members [ 874.600201] env[65322]: INFO networking_nsxv3.common.synchronization [req-bd4253ca-9799-4249-bc4c-a4e9e76235ad req-9b1de237-138e-404f-9f6a-5c689dba2ca8 service nova] Enqueued Resource ID: ac500d91-71bd-4647-9d99-2e8682b717ad with Priority: HIGHEST for action port [ 874.600863] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 with Priority: HIGHEST for action security_group_rules [ 874.600863] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 with Priority: HIGHEST for action security_group_members [ 874.600863] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac500d91-71bd-4647-9d99-2e8682b717ad with Priority: HIGHEST for action port [ 874.601209] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dae95ed3-e249-4093-bc1a-6e3471cc5953 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.601332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.601387] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.601640] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.601721] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dae95ed3-e249-4093-bc1a-6e3471cc5953',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.602597] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-dae95ed3-e249-4093-bc1a-6e3471cc5953 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.602713] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.602779] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.602950] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.603088] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.603176] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.603253] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.603393] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.603475] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.603562] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dae95ed3-e249-4093-bc1a-6e3471cc5953',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.604495] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac500d91-71bd-4647-9d99-2e8682b717ad taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.604495] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac500d91-71bd-4647-9d99-2e8682b717ad" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.604495] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac500d91-71bd-4647-9d99-2e8682b717ad" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.604653] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac500d91-71bd-4647-9d99-2e8682b717ad" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.604653] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac500d91-71bd-4647-9d99-2e8682b717ad',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.980483] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ed63561-0704-4a50-8dc8-a078d5c0c6f3: rpc.has_security_group_logging(os_id): False [ 875.004755] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.004910] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.004991] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.005223] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.005311] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.005516] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.005638] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.005713] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.005876] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.005951] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.006163] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.006255] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.006947] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.006947] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.006947] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.006947] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.006947] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.006947] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.006947] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.007301] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.008013] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 is going to be updated. [ 875.078893] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.078893] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.078893] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.079199] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.079240] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.090599] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: IN_PROGRESS for 2s [ 875.109021] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-dae95ed3-e249-4093-bc1a-6e3471cc5953 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.109021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.109021] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dae95ed3-e249-4093-bc1a-6e3471cc5953',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.109021] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac500d91-71bd-4647-9d99-2e8682b717ad with status ACTIVE [ 875.109021] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.109021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.109021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.109021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.109021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.109672] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.109672] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.109672] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.109672] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.109824] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.109990] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.110181] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.110281] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.110405] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.110496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.110693] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac500d91-71bd-4647-9d99-2e8682b717ad is going to be updated. [ 875.163560] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.163848] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.164019] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.164379] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.164627] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.164877] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac500d91-71bd-4647-9d99-2e8682b717ad" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.613499] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dae95ed3-e249-4093-bc1a-6e3471cc5953',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.116905] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.117245] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.117245] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.117491] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.117604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.117757] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 is going to be created. [ 876.153325] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.153325] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.153325] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.153325] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.153632] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.167923] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 in Status: UNINITIALIZED for 2s [ 877.107807] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: SUCCESS [ 877.108044] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.178786] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 in Status: SUCCESS [ 878.178786] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.178786] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.179211] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.179255] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.179335] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.179411] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.179725] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.179725] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.179920] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.180032] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dae95ed3-e249-4093-bc1a-6e3471cc5953',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.684227] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-dae95ed3-e249-4093-bc1a-6e3471cc5953 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.684227] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.684227] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.684227] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.684227] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.684227] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.684227] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.684227] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.684227] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.684822] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.684822] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-dae95ed3-e249-4093-bc1a-6e3471cc5953 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.684822] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.684822] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.685485] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.685979] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.686298] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.686539] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.686897] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.687179] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.687230] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.687655] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dae95ed3-e249-4093-bc1a-6e3471cc5953',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.772079] env[65322]: INFO networking_nsxv3.common.synchronization [None req-32c1bf14-2126-4bcc-80be-6075c0d05bcc None None] Enqueued Resource ID: 15920bc6-7130-437e-b549-882e1c1d9bb8 with Priority: HIGHEST for action port [ 878.772662] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15920bc6-7130-437e-b549-882e1c1d9bb8 with Priority: HIGHEST for action port [ 878.772964] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-15920bc6-7130-437e-b549-882e1c1d9bb8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.773166] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15920bc6-7130-437e-b549-882e1c1d9bb8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.773235] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15920bc6-7130-437e-b549-882e1c1d9bb8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.773506] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15920bc6-7130-437e-b549-882e1c1d9bb8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.773610] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15920bc6-7130-437e-b549-882e1c1d9bb8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.191834] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dae95ed3-e249-4093-bc1a-6e3471cc5953: rpc.has_security_group_logging(os_id): False [ 879.212679] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.212854] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.212976] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.213149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.213237] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.213494] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.213594] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.213658] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.213811] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.213888] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.214103] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.214199] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.214260] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.214397] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.214468] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.214692] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.214789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.214849] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.214992] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.215075] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.215158] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 is going to be created. [ 879.278125] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15920bc6-7130-437e-b549-882e1c1d9bb8 [ 879.278125] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.278125] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.278125] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.278125] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.278125] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.278125] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15920bc6-7130-437e-b549-882e1c1d9bb8 already deleted. [ 879.278125] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15920bc6-7130-437e-b549-882e1c1d9bb8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.283608] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.283968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.283968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.284453] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.284648] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.298084] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 in Status: IN_PROGRESS for 2s [ 879.811784] env[65322]: INFO networking_nsxv3.common.synchronization [None req-a3fb1582-a394-49f3-991c-82045157c400 tempest-AttachInterfacesTestJSON-353803948 tempest-AttachInterfacesTestJSON-353803948-project-member] Enqueued Resource ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 with Priority: HIGHEST for action security_group_rules [ 879.812751] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 with Priority: HIGHEST for action security_group_rules [ 879.812944] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.813999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.813999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.814224] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.814224] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9697a5d8-1fb8-45ef-a30e-a1b99942e3e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.991727] env[65322]: INFO networking_nsxv3.common.synchronization [None req-bd0fd269-887f-4034-9327-b9a7b55427ae tempest-AttachInterfacesTestJSON-353803948 tempest-AttachInterfacesTestJSON-353803948-project-member] Enqueued Resource ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 with Priority: HIGHEST for action security_group_rules [ 879.991808] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 with Priority: HIGHEST for action security_group_rules [ 879.992260] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.992396] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.341671] env[65322]: INFO networking_nsxv3.common.synchronization [None req-4797ce45-0059-406a-8c57-e8d1c79b2946 tempest-ServerActionsTestOtherA-1162989957 tempest-ServerActionsTestOtherA-1162989957-project-member] Enqueued Resource ID: 67117db1-586f-43f8-920a-dd7b8767d9ec with Priority: HIGHEST for action security_group_rules [ 880.346661] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.346661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.346661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.346661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.346661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.346661] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 already deleted. [ 880.346661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.347079] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67117db1-586f-43f8-920a-dd7b8767d9ec with Priority: HIGHEST for action security_group_rules [ 880.347256] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.347447] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.347534] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9697a5d8-1fb8-45ef-a30e-a1b99942e3e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.348787] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67117db1-586f-43f8-920a-dd7b8767d9ec taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.348898] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.348970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.349244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.349339] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67117db1-586f-43f8-920a-dd7b8767d9ec',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.494935] env[65322]: INFO networking_nsxv3.common.synchronization [None req-ab5451a2-a717-441a-beef-430a6c005601 tempest-ServerActionsTestOtherA-1162989957 tempest-ServerActionsTestOtherA-1162989957-project-member] Enqueued Resource ID: 67117db1-586f-43f8-920a-dd7b8767d9ec with Priority: HIGHEST for action security_group_rules [ 880.495480] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67117db1-586f-43f8-920a-dd7b8767d9ec with Priority: HIGHEST for action security_group_rules [ 880.495792] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67117db1-586f-43f8-920a-dd7b8767d9ec taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.495898] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.873337] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.873337] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.873337] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.873842] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.873842] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.873903] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 already deleted. [ 880.873993] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.875277] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.875394] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.875474] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.875651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.875802] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.875802] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67117db1-586f-43f8-920a-dd7b8767d9ec already deleted. [ 880.875878] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.876115] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.876470] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.876470] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67117db1-586f-43f8-920a-dd7b8767d9ec',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.960693] env[65322]: INFO networking_nsxv3.common.synchronization [req-e558c372-e6b3-4e4a-8825-7d3d9bee4c47 req-98022ee7-b3f3-4969-8b59-b2390fa10ab2 tempest-ImagesOneServerNegativeTestJSON-1972759635 tempest-ImagesOneServerNegativeTestJSON-1972759635-project-member] Enqueued Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGHEST for action security_group_members [ 880.963118] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGHEST for action security_group_members [ 880.963572] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1550bb0-c88b-4864-824e-b80ca3b52834 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.963710] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.963970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.963970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.964525] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.964655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.964723] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.964885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.964972] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.965080] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.133905] env[65322]: INFO networking_nsxv3.common.synchronization [None req-583960f1-7782-42bc-9db9-f12f5321637d None None] Enqueued Resource ID: 061dddaa-1228-4312-8424-96d4a12a71de with Priority: HIGHEST for action port [ 881.134843] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 061dddaa-1228-4312-8424-96d4a12a71de with Priority: HIGHEST for action port [ 881.134843] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-061dddaa-1228-4312-8424-96d4a12a71de taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.135096] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-061dddaa-1228-4312-8424-96d4a12a71de" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.135096] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-061dddaa-1228-4312-8424-96d4a12a71de" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.135323] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-061dddaa-1228-4312-8424-96d4a12a71de" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.135411] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('061dddaa-1228-4312-8424-96d4a12a71de',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.312621] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 in Status: SUCCESS [ 881.312913] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.397037] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.397320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.397401] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.398274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.398274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.398274] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67117db1-586f-43f8-920a-dd7b8767d9ec already deleted. [ 881.398274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.470851] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.471740] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.472442] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.472774] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.472883] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.473136] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.473471] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.473471] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.473620] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.473620] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.473780] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1550bb0-c88b-4864-824e-b80ca3b52834 is going to be updated. [ 881.504390] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.505728] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.505728] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.505853] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.505957] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.521097] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1550bb0-c88b-4864-824e-b80ca3b52834 in Status: IN_PROGRESS for 2s [ 881.637545] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 061dddaa-1228-4312-8424-96d4a12a71de [ 881.637545] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.637733] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.637733] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.639025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.639025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.639025] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:061dddaa-1228-4312-8424-96d4a12a71de already deleted. [ 881.639025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-061dddaa-1228-4312-8424-96d4a12a71de" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.039178] env[65322]: INFO networking_nsxv3.common.synchronization [req-39d1f689-f837-4e6d-a632-223036c42862 req-37d08773-acae-43aa-9d4a-6018497f92e8 tempest-ServersTestMultiNic-1695456669 tempest-ServersTestMultiNic-1695456669-project-member] Enqueued Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 882.040086] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 882.040400] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.040550] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.040618] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.041174] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.041174] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.041174] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.041174] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.042166] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.042166] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.042166] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.461620] env[65322]: INFO networking_nsxv3.common.synchronization [req-39d1f689-f837-4e6d-a632-223036c42862 req-2bca6271-1314-4856-b2b4-2e5eba9dd008 tempest-ServersTestMultiNic-1695456669 tempest-ServersTestMultiNic-1695456669-project-member] Enqueued Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 882.462272] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 882.462410] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.462529] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.544948] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.544948] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.544948] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.545081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.545180] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.545382] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.546534] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.546534] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.546534] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.546534] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.546534] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a07e97d-006e-4334-801f-7251980b19f1 is going to be deleted. [ 882.576333] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.576582] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.576704] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.577050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.577137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.577330] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.577540] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.577954] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.577954] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.578085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.578085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.578188] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.578267] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.578364] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.841117] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-77 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.841117] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-77" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.841117] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-77" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.841117] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-77" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.841117] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.841117] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.841117] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.841117] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.842146] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.842420] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 882.842533] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 882.842636] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 882.842737] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 882.842837] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 882.842956] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 882.843178] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 882.862416] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 882.862653] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 882.862725] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 882.862877] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-77" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.863217] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-9400003f-71b9-481c-a2c6-5223d20152de taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.863387] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-9400003f-71b9-481c-a2c6-5223d20152de" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.863551] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-9400003f-71b9-481c-a2c6-5223d20152de" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.864135] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-9400003f-71b9-481c-a2c6-5223d20152de" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.864135] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9400003f-71b9-481c-a2c6-5223d20152de',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.080933] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.081099] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.081145] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.081374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.081489] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.081706] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.081818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.081874] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.082054] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.082133] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.082221] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a07e97d-006e-4334-801f-7251980b19f1 already deleted. [ 883.082303] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.368566] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.368787] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.368905] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.369204] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.369349] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.369506] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 9400003f-71b9-481c-a2c6-5223d20152de not found, creating... [ 883.369761] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.369911] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.370029] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.370246] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.370377] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.370646] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.370795] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.370907] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.371132] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.371343] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.371507] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 9400003f-71b9-481c-a2c6-5223d20152de is going to be created. [ 883.392347] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.392767] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.392767] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.392923] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.393066] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.393617] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-9400003f-71b9-481c-a2c6-5223d20152de" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.538013] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1550bb0-c88b-4864-824e-b80ca3b52834 in Status: SUCCESS [ 883.538013] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1550bb0-c88b-4864-824e-b80ca3b52834 deletion is rescheduled due to dependency. [ 883.538013] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.116692] env[65322]: INFO networking_nsxv3.common.synchronization [req-39d1f689-f837-4e6d-a632-223036c42862 req-51ba6f2b-4c47-40c7-8f2a-71dfca8fa95e service nova] Enqueued Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_rules [ 884.116885] env[65322]: INFO networking_nsxv3.common.synchronization [req-39d1f689-f837-4e6d-a632-223036c42862 req-51ba6f2b-4c47-40c7-8f2a-71dfca8fa95e service nova] Enqueued Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 884.117112] env[65322]: INFO networking_nsxv3.common.synchronization [req-39d1f689-f837-4e6d-a632-223036c42862 req-51ba6f2b-4c47-40c7-8f2a-71dfca8fa95e service nova] Enqueued Resource ID: 9400003f-71b9-481c-a2c6-5223d20152de with Priority: HIGHEST for action port [ 884.117971] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_rules [ 884.118166] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 884.118329] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9400003f-71b9-481c-a2c6-5223d20152de with Priority: HIGHEST for action port [ 884.118762] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.118955] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.119087] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.119399] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.119570] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.123082] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.123082] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.123082] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.123252] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.123516] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.123598] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.123652] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.124129] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.124129] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.124571] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.126760] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-9400003f-71b9-481c-a2c6-5223d20152de taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.126760] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9400003f-71b9-481c-a2c6-5223d20152de" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.129809] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9400003f-71b9-481c-a2c6-5223d20152de" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.130127] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9400003f-71b9-481c-a2c6-5223d20152de" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.130436] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9400003f-71b9-481c-a2c6-5223d20152de',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.624706] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.624706] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.629327] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.634482] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9400003f-71b9-481c-a2c6-5223d20152de with status ACTIVE [ 884.634955] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.634955] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.635089] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.635284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.635354] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.635953] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.635953] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.635953] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.635953] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.635953] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.636175] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.636228] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.636255] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.636671] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.636671] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.636671] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9400003f-71b9-481c-a2c6-5223d20152de is going to be updated. [ 884.663654] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.663792] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.663873] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.664254] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.664385] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.664534] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9400003f-71b9-481c-a2c6-5223d20152de" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.789950] env[65322]: INFO networking_nsxv3.common.synchronization [req-d7ecf302-1b77-4ef0-b876-15d3d4be4390 req-f3b2e53d-1666-4799-bcd3-91bec4adc7a2 tempest-AttachVolumeTestJSON-1389790413 tempest-AttachVolumeTestJSON-1389790413-project-member] Enqueued Resource ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 with Priority: HIGHEST for action security_group_members [ 884.790519] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 with Priority: HIGHEST for action security_group_members [ 884.790847] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6d8499f-80cb-4c22-b03a-011aac96ea05 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.790989] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.791124] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.791379] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.791541] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.791908] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.791908] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.791908] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.791908] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.792144] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6d8499f-80cb-4c22-b03a-011aac96ea05',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.977306] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-594 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.977548] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-594" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.977688] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-594" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.978058] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-594" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.978369] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.978555] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.978692] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.978931] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.979258] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.979575] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 884.979742] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 884.979868] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 884.980029] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 884.980142] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 884.980274] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 884.980388] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 884.998573] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 884.998741] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 884.998874] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 884.999057] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-594" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.999731] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-429c7c17-f77d-4076-ad9b-82234d8a39a0 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.999731] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-429c7c17-f77d-4076-ad9b-82234d8a39a0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.999731] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-429c7c17-f77d-4076-ad9b-82234d8a39a0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.999987] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-429c7c17-f77d-4076-ad9b-82234d8a39a0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.000119] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('429c7c17-f77d-4076-ad9b-82234d8a39a0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.133515] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.230908] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-38 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.231144] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-38" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.231266] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-38" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.231614] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-38" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.231872] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.232043] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.232177] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.232549] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.232756] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.233035] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 885.233188] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.233343] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.233485] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.233620] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 885.233735] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.233867] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.254101] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.254320] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 885.254431] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.254639] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-38" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.254980] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-14d86987-6a56-4324-ba0a-9eb84c9eff9f taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.255185] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-14d86987-6a56-4324-ba0a-9eb84c9eff9f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.255303] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-14d86987-6a56-4324-ba0a-9eb84c9eff9f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.255626] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-14d86987-6a56-4324-ba0a-9eb84c9eff9f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.255759] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14d86987-6a56-4324-ba0a-9eb84c9eff9f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.294785] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.295024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.295024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.295273] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.295362] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.295591] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.295767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.295842] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.296017] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.296367] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.296367] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 already deleted. [ 885.296367] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.502949] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.503177] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.503304] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.503639] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.503817] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.503982] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 429c7c17-f77d-4076-ad9b-82234d8a39a0 not found, creating... [ 885.504282] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.504464] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.504582] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.504809] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.504944] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.505236] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.505382] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.505493] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.505693] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.505843] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.505987] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 429c7c17-f77d-4076-ad9b-82234d8a39a0 is going to be created. [ 885.527886] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.528312] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.528493] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.528783] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.529027] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.529276] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-429c7c17-f77d-4076-ad9b-82234d8a39a0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.637380] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.637380] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.637380] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.637874] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.637874] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.637874] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a07e97d-006e-4334-801f-7251980b19f1 is going to be created. [ 885.663685] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.663895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.663895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.664116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.664277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.678098] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: UNINITIALIZED for 2s [ 885.758156] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.759198] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.759290] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.759532] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.759689] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.759852] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 14d86987-6a56-4324-ba0a-9eb84c9eff9f not found, creating... [ 885.760151] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.760331] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.760448] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.760673] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.760806] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.761167] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.761368] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.761501] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.761713] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.761840] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.761978] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 14d86987-6a56-4324-ba0a-9eb84c9eff9f is going to be created. [ 885.784735] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.785011] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.785158] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.785466] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.785713] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.785967] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-14d86987-6a56-4324-ba0a-9eb84c9eff9f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.275342] env[65322]: INFO networking_nsxv3.common.synchronization [req-39d1f689-f837-4e6d-a632-223036c42862 req-049e60fb-b6b5-4b20-916b-ff48fb22d916 service nova] Enqueued Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_rules [ 886.275522] env[65322]: INFO networking_nsxv3.common.synchronization [req-39d1f689-f837-4e6d-a632-223036c42862 req-049e60fb-b6b5-4b20-916b-ff48fb22d916 service nova] Enqueued Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 886.275657] env[65322]: INFO networking_nsxv3.common.synchronization [req-39d1f689-f837-4e6d-a632-223036c42862 req-049e60fb-b6b5-4b20-916b-ff48fb22d916 service nova] Enqueued Resource ID: 429c7c17-f77d-4076-ad9b-82234d8a39a0 with Priority: HIGHEST for action port [ 886.276268] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_rules [ 886.276403] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 886.276499] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 429c7c17-f77d-4076-ad9b-82234d8a39a0 with Priority: HIGHEST for action port [ 886.276787] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.277321] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.277321] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.277528] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.277584] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-429c7c17-f77d-4076-ad9b-82234d8a39a0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.277716] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-429c7c17-f77d-4076-ad9b-82234d8a39a0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.277716] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-429c7c17-f77d-4076-ad9b-82234d8a39a0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.277919] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-429c7c17-f77d-4076-ad9b-82234d8a39a0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.277993] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('429c7c17-f77d-4076-ad9b-82234d8a39a0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.510021] env[65322]: INFO networking_nsxv3.common.synchronization [req-d7ecf302-1b77-4ef0-b876-15d3d4be4390 req-fb8d4f9b-5541-4e25-b5ef-513399b2b5e7 service nova] Enqueued Resource ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 with Priority: HIGHEST for action security_group_rules [ 886.510021] env[65322]: INFO networking_nsxv3.common.synchronization [req-d7ecf302-1b77-4ef0-b876-15d3d4be4390 req-fb8d4f9b-5541-4e25-b5ef-513399b2b5e7 service nova] Enqueued Resource ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 with Priority: HIGHEST for action security_group_members [ 886.510021] env[65322]: INFO networking_nsxv3.common.synchronization [req-d7ecf302-1b77-4ef0-b876-15d3d4be4390 req-fb8d4f9b-5541-4e25-b5ef-513399b2b5e7 service nova] Enqueued Resource ID: 14d86987-6a56-4324-ba0a-9eb84c9eff9f with Priority: HIGHEST for action port [ 886.510300] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 with Priority: HIGHEST for action security_group_rules [ 886.510521] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 with Priority: HIGHEST for action security_group_members [ 886.510686] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14d86987-6a56-4324-ba0a-9eb84c9eff9f with Priority: HIGHEST for action port [ 886.511127] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6d8499f-80cb-4c22-b03a-011aac96ea05 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.511385] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.511601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.511868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.512030] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6d8499f-80cb-4c22-b03a-011aac96ea05',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.513733] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6d8499f-80cb-4c22-b03a-011aac96ea05 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.513733] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.513733] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.513733] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.513733] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.513733] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.513917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.513917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.513985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.517268] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6d8499f-80cb-4c22-b03a-011aac96ea05',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.518147] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-14d86987-6a56-4324-ba0a-9eb84c9eff9f taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.518256] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14d86987-6a56-4324-ba0a-9eb84c9eff9f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.518324] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14d86987-6a56-4324-ba0a-9eb84c9eff9f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.518499] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14d86987-6a56-4324-ba0a-9eb84c9eff9f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.518595] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14d86987-6a56-4324-ba0a-9eb84c9eff9f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.780569] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 429c7c17-f77d-4076-ad9b-82234d8a39a0 with status ACTIVE [ 886.780944] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.781167] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.781317] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.781622] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.781768] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.782069] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.782225] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.782332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.782559] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.782699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.783268] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.783268] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.783268] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.783486] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.783532] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.783652] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 429c7c17-f77d-4076-ad9b-82234d8a39a0 is going to be updated. [ 886.808600] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.808760] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.808840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.809042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.809179] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.809334] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-429c7c17-f77d-4076-ad9b-82234d8a39a0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.020963] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14d86987-6a56-4324-ba0a-9eb84c9eff9f with status ACTIVE [ 887.021226] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.021368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.021520] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.021660] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.021753] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.021936] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.022189] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.022189] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.022264] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.022331] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.022510] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.022602] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.022662] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.022798] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.022869] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.022951] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14d86987-6a56-4324-ba0a-9eb84c9eff9f is going to be updated. [ 887.024385] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6d8499f-80cb-4c22-b03a-011aac96ea05 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.024517] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.024811] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6d8499f-80cb-4c22-b03a-011aac96ea05',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.047325] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.047468] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.047540] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.047739] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.048984] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.049178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14d86987-6a56-4324-ba0a-9eb84c9eff9f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.526848] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6d8499f-80cb-4c22-b03a-011aac96ea05',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.692020] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: SUCCESS [ 887.692257] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.692419] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.692624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.692806] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.692915] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.692981] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.693137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.693213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.693296] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.693392] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.695925] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.696085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.696227] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.696336] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.696434] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.696566] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.696607] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.696698] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.030254] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.030570] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.030570] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.030686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.030774] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.030872] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 is going to be created. [ 888.054984] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.055182] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.055264] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.055504] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.055664] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.065762] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 in Status: UNINITIALIZED for 2s [ 888.198704] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.198885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.199035] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.701602] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.204410] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.204711] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.204711] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.204948] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.205061] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.205191] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a07e97d-006e-4334-801f-7251980b19f1 is going to be updated. [ 889.244451] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.244932] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.244932] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.245057] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.245228] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.262794] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: IN_PROGRESS for 2s [ 889.413505] env[65322]: INFO networking_nsxv3.common.synchronization [req-e4c9dda6-ca20-4be2-b7c8-9fdf638cfa11 req-5a6fe7e8-98a9-4734-86d9-94430f310638 tempest-ListServerFiltersTestJSON-548115459 tempest-ListServerFiltersTestJSON-548115459-project-member] Enqueued Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGHEST for action security_group_members [ 889.413505] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGHEST for action security_group_members [ 889.413663] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.413740] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.413815] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.414092] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.414259] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.414359] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.414479] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.414745] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.414745] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.414840] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.637186] env[65322]: INFO networking_nsxv3.common.synchronization [req-0480027c-09cb-463d-a957-da2d5e81e04a req-a6e6ecb3-4872-4c4e-9fb3-299fbfbcc92e tempest-DeleteServersTestJSON-1463403857 tempest-DeleteServersTestJSON-1463403857-project-member] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 889.637186] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 889.637186] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.637186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.637186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.637186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.637186] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.637186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.637186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.639090] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.639280] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.639457] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.918232] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.918403] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.918483] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.918720] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.918830] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.919083] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.919180] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.919244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.919388] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.919462] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.919545] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eae2009-1124-44b2-a496-3582997767b0 is going to be updated. [ 889.948020] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.948176] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.948239] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.948449] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.948589] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.958469] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eae2009-1124-44b2-a496-3582997767b0 in Status: IN_PROGRESS for 2s [ 889.999122] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.999488] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.999765] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.000126] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.000463] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.000740] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.000968] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.001297] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.001524] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.001822] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 890.002348] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 890.002348] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 890.002348] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 890.002348] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 890.002608] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 890.002608] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 890.022985] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 890.023269] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 890.023343] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 890.023547] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.023797] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-60ddd13c-2b9c-4204-8eac-1fe013da6d4e taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.023972] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-60ddd13c-2b9c-4204-8eac-1fe013da6d4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.024104] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-60ddd13c-2b9c-4204-8eac-1fe013da6d4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.024433] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-60ddd13c-2b9c-4204-8eac-1fe013da6d4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.024866] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60ddd13c-2b9c-4204-8eac-1fe013da6d4e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.076905] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 in Status: SUCCESS [ 890.078026] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.078026] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.078026] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.078026] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.078026] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.078026] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.078258] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.078258] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.078258] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.078360] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6d8499f-80cb-4c22-b03a-011aac96ea05',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.142952] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.142952] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.142952] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.143192] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.143192] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.143446] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.143632] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.143731] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.143954] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.144178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.144362] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be deleted. [ 890.177034] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.177034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.177240] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.177336] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.177396] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.177501] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.531372] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.531372] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.531372] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.531372] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.531372] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.531372] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 60ddd13c-2b9c-4204-8eac-1fe013da6d4e not found, creating... [ 890.531372] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.531372] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.531372] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.531372] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.531372] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.532073] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.532073] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.532073] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.533453] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.533641] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.533822] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 60ddd13c-2b9c-4204-8eac-1fe013da6d4e is going to be created. [ 890.555849] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.558024] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.558024] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.558024] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.558024] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.558024] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-60ddd13c-2b9c-4204-8eac-1fe013da6d4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.581817] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6d8499f-80cb-4c22-b03a-011aac96ea05',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.085032] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6d8499f-80cb-4c22-b03a-011aac96ea05: rpc.has_security_group_logging(os_id): False [ 891.107025] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.107025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.107025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.107025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.107025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.107025] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.107025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.107025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.107025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.107025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.107025] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 is going to be created. [ 891.174221] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.174434] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.174571] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.175014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.175014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.190661] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 in Status: IN_PROGRESS for 2s [ 891.274193] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: SUCCESS [ 891.274380] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.274625] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.274877] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.275101] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.275233] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.275299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.275577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.275677] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.275758] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.275943] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.276102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.276160] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.276338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.276517] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.276614] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.276678] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.279092] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.279219] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.279319] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.279415] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.409962] env[65322]: INFO networking_nsxv3.common.synchronization [req-0480027c-09cb-463d-a957-da2d5e81e04a req-116b2ed0-7012-4e23-a7a3-ac6b0945b35a service nova] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_rules [ 891.410138] env[65322]: INFO networking_nsxv3.common.synchronization [req-0480027c-09cb-463d-a957-da2d5e81e04a req-116b2ed0-7012-4e23-a7a3-ac6b0945b35a service nova] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 891.410574] env[65322]: INFO networking_nsxv3.common.synchronization [req-0480027c-09cb-463d-a957-da2d5e81e04a req-116b2ed0-7012-4e23-a7a3-ac6b0945b35a service nova] Enqueued Resource ID: 60ddd13c-2b9c-4204-8eac-1fe013da6d4e with Priority: HIGHEST for action port [ 891.410914] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_rules [ 891.411188] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 891.411359] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60ddd13c-2b9c-4204-8eac-1fe013da6d4e with Priority: HIGHEST for action port [ 891.411721] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.411856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.411922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.412234] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.412382] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.413475] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.413785] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.413843] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.414991] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.415215] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.415585] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.415585] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.415585] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.415703] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.415864] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.416869] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-60ddd13c-2b9c-4204-8eac-1fe013da6d4e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.416973] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60ddd13c-2b9c-4204-8eac-1fe013da6d4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.417015] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60ddd13c-2b9c-4204-8eac-1fe013da6d4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.417369] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60ddd13c-2b9c-4204-8eac-1fe013da6d4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.417369] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60ddd13c-2b9c-4204-8eac-1fe013da6d4e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.784174] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a07e97d-006e-4334-801f-7251980b19f1: rpc.has_security_group_logging(os_id): False [ 891.803078] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.803243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.803302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.803561] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.803652] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.803861] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.803953] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.804063] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.804184] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.804270] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.804430] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.804513] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.804571] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.804705] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.804766] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.804940] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.806455] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.806572] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.806731] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.806812] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.806909] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a07e97d-006e-4334-801f-7251980b19f1 is going to be created. [ 891.870926] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.871139] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.871203] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.871417] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.871610] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.885860] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: IN_PROGRESS for 2s [ 891.919665] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.919665] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.920189] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.921280] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60ddd13c-2b9c-4204-8eac-1fe013da6d4e with status ACTIVE [ 891.921280] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.923785] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.923995] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.924204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.924305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.924523] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.924666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.924666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.924891] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.924961] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.925113] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.925262] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.925315] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.925485] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.925485] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.925636] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60ddd13c-2b9c-4204-8eac-1fe013da6d4e is going to be updated. [ 891.965372] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.965575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.965575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.965784] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.965920] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.966090] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60ddd13c-2b9c-4204-8eac-1fe013da6d4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.968532] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eae2009-1124-44b2-a496-3582997767b0 in Status: SUCCESS [ 891.968634] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eae2009-1124-44b2-a496-3582997767b0 deletion is rescheduled due to dependency. [ 891.968737] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.428311] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.932150] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.932413] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.932538] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.932853] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.932956] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.933074] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be created. [ 892.959093] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.959093] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.959093] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.959093] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.959519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.972483] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: UNINITIALIZED for 2s [ 893.205386] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 in Status: SUCCESS [ 893.205638] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.900506] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: SUCCESS [ 893.900836] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.901145] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.901421] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.901551] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.404266] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.404730] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.404933] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.405489] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.405716] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.405844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.405915] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.406101] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.406189] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.406278] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.406395] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.739933] env[65322]: INFO networking_nsxv3.common.synchronization [req-3c5ac315-38e8-43dd-adc2-b7cc9428c8c1 req-846ff4e8-db5a-4114-95cc-b41775032bd0 tempest-ImagesTestJSON-2080608290 tempest-ImagesTestJSON-2080608290-project-member] Enqueued Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 894.740739] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 894.741191] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.741378] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.741559] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.741872] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.742138] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.742314] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.742414] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.742668] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.742815] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.742980] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.908420] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.908573] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.908640] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.908862] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.909034] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.909155] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.909218] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.909379] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.909442] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.909531] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.909674] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.909755] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.909808] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.909942] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.910093] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.910179] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.910233] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.910365] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.910431] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.910503] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.910585] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.987199] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: SUCCESS [ 894.987479] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.988089] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.988364] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.988509] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.988726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.988726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.988853] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.988909] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.988985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.990074] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.117948] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-564 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.118149] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-564" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.118270] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-564" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.118535] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-564" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.118975] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.119176] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.119290] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.119545] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.119686] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.119887] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.119994] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 895.120115] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 895.120205] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 895.120579] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.120579] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 895.120579] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 895.141319] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 895.141319] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 895.141603] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 895.141665] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-564" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.141982] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-adef2e76-f07f-41e1-82b1-05d4f7c2d246 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.142169] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-adef2e76-f07f-41e1-82b1-05d4f7c2d246" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.142285] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-adef2e76-f07f-41e1-82b1-05d4f7c2d246" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.142606] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-adef2e76-f07f-41e1-82b1-05d4f7c2d246" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.142755] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adef2e76-f07f-41e1-82b1-05d4f7c2d246',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.246413] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.414147] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a07e97d-006e-4334-801f-7251980b19f1: rpc.has_security_group_logging(os_id): False [ 895.435386] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.435495] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.435587] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.435805] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.435925] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.436175] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.436299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.436377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.436562] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.436680] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.436892] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.437216] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.437216] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.437313] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.437354] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.437542] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.437647] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.437721] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.437886] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.437976] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.438091] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a07e97d-006e-4334-801f-7251980b19f1 is going to be updated. [ 895.496527] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.496719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.496808] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.497604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.497604] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.497604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.497604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.497604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.497604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.497604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.497927] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.497927] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.497927] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.498126] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.498219] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.498310] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.498379] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.498576] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.498650] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.498730] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.498821] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.507116] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.507116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.507116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.507116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.507116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.525029] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: IN_PROGRESS for 2s [ 895.645470] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.645762] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.647572] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.647572] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.647572] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.647572] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port adef2e76-f07f-41e1-82b1-05d4f7c2d246 not found, creating... [ 895.647572] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.647572] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.647572] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.647954] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.647954] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.648210] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.648439] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.648549] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.648852] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.649018] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.649260] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: adef2e76-f07f-41e1-82b1-05d4f7c2d246 is going to be created. [ 895.675050] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.675386] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.676381] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.676381] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.676381] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.676783] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-adef2e76-f07f-41e1-82b1-05d4f7c2d246" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.748478] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.003475] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e863a544-814a-4bca-b4b1-35f9a61afcd3: rpc.has_security_group_logging(os_id): False [ 896.021988] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.023659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.023659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.023659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.023659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.023659] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.023659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.023659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.023659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.023659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.023944] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.023944] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.023944] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.024048] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.024417] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.024677] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.024785] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.024905] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.025016] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.025111] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.025201] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be created. [ 896.089754] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.089938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.090020] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.090197] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.090376] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.101145] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: IN_PROGRESS for 2s [ 896.251241] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.251403] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.251476] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.251700] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.251793] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.251894] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 is going to be updated. [ 896.288232] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.288485] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.288485] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.288790] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.288949] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.303762] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: IN_PROGRESS for 2s [ 896.434896] env[65322]: INFO networking_nsxv3.common.synchronization [req-3c5ac315-38e8-43dd-adc2-b7cc9428c8c1 req-e7c41dbe-644b-487f-b608-9908e65442c1 service nova] Enqueued Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_rules [ 896.435172] env[65322]: INFO networking_nsxv3.common.synchronization [req-3c5ac315-38e8-43dd-adc2-b7cc9428c8c1 req-e7c41dbe-644b-487f-b608-9908e65442c1 service nova] Enqueued Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 896.435218] env[65322]: INFO networking_nsxv3.common.synchronization [req-3c5ac315-38e8-43dd-adc2-b7cc9428c8c1 req-e7c41dbe-644b-487f-b608-9908e65442c1 service nova] Enqueued Resource ID: adef2e76-f07f-41e1-82b1-05d4f7c2d246 with Priority: HIGHEST for action port [ 896.435709] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_rules [ 896.435838] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 896.435930] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adef2e76-f07f-41e1-82b1-05d4f7c2d246 with Priority: HIGHEST for action port [ 896.437324] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.437832] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.437910] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.438138] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.438222] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.439752] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.439865] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.440162] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-adef2e76-f07f-41e1-82b1-05d4f7c2d246 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.440220] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adef2e76-f07f-41e1-82b1-05d4f7c2d246" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.440284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adef2e76-f07f-41e1-82b1-05d4f7c2d246" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.440452] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adef2e76-f07f-41e1-82b1-05d4f7c2d246" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.440543] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adef2e76-f07f-41e1-82b1-05d4f7c2d246',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.940362] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.940362] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.943023] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port adef2e76-f07f-41e1-82b1-05d4f7c2d246 with status ACTIVE [ 896.943023] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.943023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.943023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.943381] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.943381] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.943587] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.943700] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.943762] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.943939] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.944008] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.944191] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.944284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.944346] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.944496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.944588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.944691] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: adef2e76-f07f-41e1-82b1-05d4f7c2d246 is going to be updated. [ 896.966939] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.967117] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.967160] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.967359] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.967456] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.967601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adef2e76-f07f-41e1-82b1-05d4f7c2d246" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.540877] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: SUCCESS [ 897.540877] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.582536] env[65322]: INFO networking_nsxv3.common.synchronization [req-3834c692-bcf4-4472-ab41-c9d2a7d50eaf req-5de9251b-8488-4c48-91e5-bf8f2521fbb8 tempest-ServersTestMultiNic-1695456669 tempest-ServersTestMultiNic-1695456669-project-member] Enqueued Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 897.582536] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 897.584041] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.584041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.584041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.584041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.584436] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.584642] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.584787] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.585033] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.585202] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.585761] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.848563] env[65322]: INFO networking_nsxv3.common.synchronization [req-3834c692-bcf4-4472-ab41-c9d2a7d50eaf req-15f125f9-ad82-429f-aaa4-85d9da598e23 tempest-ServersTestMultiNic-1695456669 tempest-ServersTestMultiNic-1695456669-project-member] Enqueued Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 897.848563] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGHEST for action security_group_members [ 897.848563] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.848563] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.087986] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.122039] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: SUCCESS [ 898.122322] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.315268] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: SUCCESS [ 898.315268] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.315268] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.315268] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.315535] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.315535] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.315664] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.315749] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.315869] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.316034] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.590857] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.818739] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.094247] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.094420] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.094543] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.094833] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.094966] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.095153] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a07e97d-006e-4334-801f-7251980b19f1 is going to be updated. [ 899.126748] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.126907] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.127051] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.127306] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.127429] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.136555] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: IN_PROGRESS for 2s [ 899.321438] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.824538] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.824922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.824922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.824994] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.825101] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.825204] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 is going to be updated. [ 899.853754] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.853951] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.854054] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.854295] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.854443] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.863371] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: IN_PROGRESS for 2s [ 901.150979] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: SUCCESS [ 901.151470] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.151470] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.151808] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.151926] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.152057] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.152155] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.152272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.152350] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.152443] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.657026] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.657026] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.657026] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.657026] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.657026] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.657026] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.657026] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.657026] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.657026] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.657026] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.657561] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a07e97d-006e-4334-801f-7251980b19f1 is going to be updated. [ 901.691166] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.691368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.691481] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.691620] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.693531] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.706110] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: IN_PROGRESS for 2s [ 901.876414] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: SUCCESS [ 901.876664] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.876975] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.877249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.877482] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.877566] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.877644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.879302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.879713] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.879713] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.879713] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.382606] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.382979] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.382979] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.383236] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.383471] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.383654] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.383734] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.383931] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.384039] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.384148] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.384357] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.384457] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.384542] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.384774] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.384933] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.385037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.385099] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.385266] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.385341] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.385426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.385514] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.847821] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 902.848098] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 902.888285] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16: rpc.has_security_group_logging(os_id): False [ 902.910161] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.910453] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.910617] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.910974] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.911168] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.911527] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.911793] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.911913] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.912369] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.912506] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.912856] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.912975] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.913110] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.913367] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.913503] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.913878] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.914105] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.914199] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.914443] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.914701] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.914827] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 is going to be updated. [ 902.988420] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.988420] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.988420] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.988420] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.988420] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.001735] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: IN_PROGRESS for 2s [ 903.046755] env[65322]: INFO networking_nsxv3.common.synchronization [req-44bdefa0-ef2c-42b0-a4e8-763ecd424a55 req-e87a9261-d8e9-4ae6-8bb9-a3bcfdebcd92 tempest-MultipleCreateTestJSON-731324011 tempest-MultipleCreateTestJSON-731324011-project-member] Enqueued Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_members [ 903.047935] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_members [ 903.047935] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.047935] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.048191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.048528] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.048844] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.049027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.049131] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.049333] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.049456] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.049580] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.552742] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.553095] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.553095] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.553236] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.553338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.553647] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.553784] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.553867] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.554084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.554186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.554302] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a already deleted. [ 903.554409] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.693830] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-755 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.693830] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-755" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.693830] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-755" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.694240] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-755" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.694518] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.694676] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.694822] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.695176] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.695238] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.695816] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 903.695816] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 903.695816] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 903.695816] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 903.696043] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 903.696043] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 903.696189] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 903.717677] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a07e97d-006e-4334-801f-7251980b19f1 in Status: SUCCESS [ 903.717888] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a07e97d-006e-4334-801f-7251980b19f1 deletion is rescheduled due to dependency. [ 903.717989] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.719858] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 903.719997] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 903.720156] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 903.720336] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-755" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.720713] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-e191227e-13dd-40bc-975b-d7753b68c2b8 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.720935] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-e191227e-13dd-40bc-975b-d7753b68c2b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.721077] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-e191227e-13dd-40bc-975b-d7753b68c2b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.721535] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-e191227e-13dd-40bc-975b-d7753b68c2b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.721657] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e191227e-13dd-40bc-975b-d7753b68c2b8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.225330] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.225680] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.225884] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.226235] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.226383] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.226542] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port e191227e-13dd-40bc-975b-d7753b68c2b8 not found, creating... [ 904.227287] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.227287] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.227287] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.227509] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.227614] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.227929] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.228129] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.228417] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.228550] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.228679] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.228964] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: e191227e-13dd-40bc-975b-d7753b68c2b8 is going to be created. [ 904.250884] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.252972] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.253570] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.254046] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.254928] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.255201] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-e191227e-13dd-40bc-975b-d7753b68c2b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.020356] env[65322]: INFO networking_nsxv3.common.synchronization [req-44bdefa0-ef2c-42b0-a4e8-763ecd424a55 req-d50e71c1-172d-42cd-a832-15534834a45b service nova] Enqueued Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_rules [ 905.020645] env[65322]: INFO networking_nsxv3.common.synchronization [req-44bdefa0-ef2c-42b0-a4e8-763ecd424a55 req-d50e71c1-172d-42cd-a832-15534834a45b service nova] Enqueued Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_members [ 905.021881] env[65322]: INFO networking_nsxv3.common.synchronization [req-44bdefa0-ef2c-42b0-a4e8-763ecd424a55 req-d50e71c1-172d-42cd-a832-15534834a45b service nova] Enqueued Resource ID: e191227e-13dd-40bc-975b-d7753b68c2b8 with Priority: HIGHEST for action port [ 905.021881] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_rules [ 905.021881] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_members [ 905.021881] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e191227e-13dd-40bc-975b-d7753b68c2b8 with Priority: HIGHEST for action port [ 905.024118] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.024118] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.024118] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.024118] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.024118] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.025275] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.025275] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.025275] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.025455] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.025543] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.025596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.025632] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.026492] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.026492] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.026492] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.026852] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-e191227e-13dd-40bc-975b-d7753b68c2b8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.026936] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e191227e-13dd-40bc-975b-d7753b68c2b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.026987] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e191227e-13dd-40bc-975b-d7753b68c2b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.027147] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e191227e-13dd-40bc-975b-d7753b68c2b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.028042] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e191227e-13dd-40bc-975b-d7753b68c2b8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.029771] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: SUCCESS [ 905.030018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.424271] env[65322]: INFO networking_nsxv3.common.synchronization [req-44bdefa0-ef2c-42b0-a4e8-763ecd424a55 req-8e6983c9-3453-447d-a06d-eb7b702eecd5 tempest-MultipleCreateTestJSON-731324011 tempest-MultipleCreateTestJSON-731324011-project-member] Enqueued Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_members [ 905.425094] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_members [ 905.425479] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.425578] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.529772] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.530095] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.530095] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.532113] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e191227e-13dd-40bc-975b-d7753b68c2b8 with status ACTIVE [ 905.532113] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.532113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.532113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.532113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.532113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.532113] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.532113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.532486] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.532486] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.532486] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.532566] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.532669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.532760] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.532837] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.532909] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.532990] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e191227e-13dd-40bc-975b-d7753b68c2b8 is going to be updated. [ 905.557904] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.558131] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.558131] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.558404] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.558573] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.561516] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e191227e-13dd-40bc-975b-d7753b68c2b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.815580] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-755 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.815580] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-755" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.815580] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-755" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.815580] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-755" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.815879] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.816063] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.816175] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.816452] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.816582] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.816729] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 905.816839] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 905.816949] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 905.817065] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 905.817236] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 905.817353] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 905.817510] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 905.837687] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 905.838153] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 905.838301] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 905.838432] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-755" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.838763] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-5d36842b-11fd-475f-93a1-5d213b9e9a70 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.838973] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-5d36842b-11fd-475f-93a1-5d213b9e9a70" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.839134] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-5d36842b-11fd-475f-93a1-5d213b9e9a70" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.839461] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-5d36842b-11fd-475f-93a1-5d213b9e9a70" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.839589] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d36842b-11fd-475f-93a1-5d213b9e9a70',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.034872] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.342582] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.344116] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.344116] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.344116] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.344116] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.344229] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 5d36842b-11fd-475f-93a1-5d213b9e9a70 not found, creating... [ 906.344425] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.344569] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.344819] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.345475] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.345475] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.348800] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.349118] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.349178] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.349583] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.349583] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.349685] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 5d36842b-11fd-475f-93a1-5d213b9e9a70 is going to be created. [ 906.376760] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.376975] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.377194] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.377558] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.378015] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.378260] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-5d36842b-11fd-475f-93a1-5d213b9e9a70" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.537480] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.537859] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.538016] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.538292] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.538472] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.538596] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a is going to be created. [ 906.577547] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.577767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.577850] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.578147] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.578373] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.590922] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: UNINITIALIZED for 2s [ 907.181172] env[65322]: INFO networking_nsxv3.common.synchronization [req-44bdefa0-ef2c-42b0-a4e8-763ecd424a55 req-4520373d-4fc2-459b-9dc6-0c40ac69cb15 service nova] Enqueued Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_rules [ 907.181172] env[65322]: INFO networking_nsxv3.common.synchronization [req-44bdefa0-ef2c-42b0-a4e8-763ecd424a55 req-4520373d-4fc2-459b-9dc6-0c40ac69cb15 service nova] Enqueued Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_members [ 907.181172] env[65322]: INFO networking_nsxv3.common.synchronization [req-44bdefa0-ef2c-42b0-a4e8-763ecd424a55 req-4520373d-4fc2-459b-9dc6-0c40ac69cb15 service nova] Enqueued Resource ID: 5d36842b-11fd-475f-93a1-5d213b9e9a70 with Priority: HIGHEST for action port [ 907.182029] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_rules [ 907.182029] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_members [ 907.182178] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d36842b-11fd-475f-93a1-5d213b9e9a70 with Priority: HIGHEST for action port [ 907.182469] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.182576] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.182787] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.182882] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.183240] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d36842b-11fd-475f-93a1-5d213b9e9a70 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.183445] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d36842b-11fd-475f-93a1-5d213b9e9a70" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.183534] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d36842b-11fd-475f-93a1-5d213b9e9a70" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.183810] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d36842b-11fd-475f-93a1-5d213b9e9a70" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.183901] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d36842b-11fd-475f-93a1-5d213b9e9a70',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.688282] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d36842b-11fd-475f-93a1-5d213b9e9a70 with status ACTIVE [ 907.688505] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.688640] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.688707] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.688923] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.689033] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.689218] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.689363] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.689363] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.689530] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.689588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.689764] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.689890] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.689922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.690302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.690441] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.690489] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d36842b-11fd-475f-93a1-5d213b9e9a70 is going to be updated. [ 907.718092] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.718270] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.718311] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.718636] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.718826] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.719013] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d36842b-11fd-475f-93a1-5d213b9e9a70" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.603709] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: SUCCESS [ 908.603709] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.603709] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.604116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.604952] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.604952] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.604952] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.604952] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.604952] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.604952] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.108971] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.613477] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.946230] env[65322]: INFO networking_nsxv3.common.synchronization [req-6b4b0181-898c-475c-a030-bf19d9d3f9ef req-bafcb7e0-699e-483d-bf29-d1f63e59a5df tempest-MigrationsAdminTest-1504175931 tempest-MigrationsAdminTest-1504175931-project-member] Enqueued Resource ID: 26df6822-523e-4c95-9d74-db0cddb065c0 with Priority: HIGHEST for action security_group_members [ 909.946919] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26df6822-523e-4c95-9d74-db0cddb065c0 with Priority: HIGHEST for action security_group_members [ 909.947260] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-26df6822-523e-4c95-9d74-db0cddb065c0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.948041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.948041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.948041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.948041] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.948041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.948041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.948443] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.948443] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.948443] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26df6822-523e-4c95-9d74-db0cddb065c0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.117018] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.117231] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.117332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.118042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.118151] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.118264] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a is going to be updated. [ 910.158294] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.158624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.158624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.158972] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.159217] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.175654] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: IN_PROGRESS for 2s [ 910.451099] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('26df6822-523e-4c95-9d74-db0cddb065c0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.750135] env[65322]: INFO networking_nsxv3.common.synchronization [req-05bb64fb-3dab-4857-ac4d-31ce292c7d29 req-73b76d40-3193-48b0-ae87-930d1c409b62 tempest-FloatingIPsAssociationTestJSON-408950981 tempest-FloatingIPsAssociationTestJSON-408950981-project-member] Enqueued Resource ID: 739eb2bf-8f60-406e-b099-1671d90b8545 with Priority: HIGHEST for action security_group_members [ 910.751154] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 739eb2bf-8f60-406e-b099-1671d90b8545 with Priority: HIGHEST for action security_group_members [ 910.751816] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-739eb2bf-8f60-406e-b099-1671d90b8545 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.752022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.752143] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.752427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.752666] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.752837] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.752913] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.753102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.753299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.753299] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('739eb2bf-8f60-406e-b099-1671d90b8545',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.953810] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('26df6822-523e-4c95-9d74-db0cddb065c0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.257308] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.257530] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.257530] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.257781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.257871] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.258101] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.258228] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.258324] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.258497] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.258577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.258666] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 739eb2bf-8f60-406e-b099-1671d90b8545 is going to be updated. [ 911.297536] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.298075] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.298075] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.298075] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.298205] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.308429] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 739eb2bf-8f60-406e-b099-1671d90b8545 in Status: IN_PROGRESS for 2s [ 911.399621] env[65322]: INFO networking_nsxv3.common.synchronization [req-d21fe685-0123-4c1e-9adc-7d4d870e00e9 req-92556403-2135-42b7-8961-fe4b8eb6176a tempest-ServersWithSpecificFlavorTestJSON-940507922 tempest-ServersWithSpecificFlavorTestJSON-940507922-project-member] Enqueued Resource ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 with Priority: HIGHEST for action security_group_members [ 911.400199] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 with Priority: HIGHEST for action security_group_members [ 911.400681] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-260ad733-0f5d-43fb-be04-c8ecbbbcea08 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.400681] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.400681] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.400884] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.401045] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.401154] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.401193] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.401342] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.401426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.401518] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('260ad733-0f5d-43fb-be04-c8ecbbbcea08',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.456594] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.456828] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.456911] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.457147] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.457242] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.457342] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26df6822-523e-4c95-9d74-db0cddb065c0 is going to be updated. [ 911.486055] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.486055] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.486055] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.486435] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.486435] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.495339] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26df6822-523e-4c95-9d74-db0cddb065c0 in Status: IN_PROGRESS for 2s [ 911.903831] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.904215] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.904215] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.904376] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.927383] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.927744] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.927898] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.927973] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.928226] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.928325] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.928424] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 is going to be updated. [ 911.960271] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.960604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.960604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.960737] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.961331] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.971965] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 in Status: IN_PROGRESS for 2s [ 912.188257] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: SUCCESS [ 912.188524] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.188725] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.188945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.189211] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.189358] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.189458] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.189566] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.189686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.189718] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.189826] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.192800] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.193022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.193229] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.193362] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.193427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.194034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.194034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.194034] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.694708] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.694961] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.697587] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.995651] env[65322]: INFO networking_nsxv3.common.synchronization [req-314ba477-e8dc-4f12-a98e-553cfff1aab6 req-b0e2c7e1-20fe-4edb-b846-c0338176570a tempest-ServerRescueNegativeTestJSON-325476461 tempest-ServerRescueNegativeTestJSON-325476461-project-member] Enqueued Resource ID: 429d42d7-e5e7-4ade-9c7f-c5151648e98f with Priority: HIGHEST for action security_group_members [ 912.996540] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 429d42d7-e5e7-4ade-9c7f-c5151648e98f with Priority: HIGHEST for action security_group_members [ 912.996841] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-429d42d7-e5e7-4ade-9c7f-c5151648e98f taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.996979] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.997038] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.997294] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.997471] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.997577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.997640] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.997800] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.997885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.997979] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('429d42d7-e5e7-4ade-9c7f-c5151648e98f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.200367] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.320783] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 739eb2bf-8f60-406e-b099-1671d90b8545 in Status: SUCCESS [ 913.320961] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 739eb2bf-8f60-406e-b099-1671d90b8545 deletion is rescheduled due to dependency. [ 913.321126] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-739eb2bf-8f60-406e-b099-1671d90b8545" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.430531] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-167 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.430834] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-167" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.431068] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-167" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.431433] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-167" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.432059] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.432059] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.432803] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.432803] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.432803] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.433472] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 913.433472] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 913.433472] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 913.433781] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 913.433781] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 913.434463] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 913.434463] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 913.458713] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 913.458945] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 913.459164] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 913.459386] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-167" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.459772] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-118ec609-3550-4cc4-99ee-b8ce9838f91e taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.460029] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-118ec609-3550-4cc4-99ee-b8ce9838f91e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.460194] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-118ec609-3550-4cc4-99ee-b8ce9838f91e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.460592] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-118ec609-3550-4cc4-99ee-b8ce9838f91e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.462137] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('118ec609-3550-4cc4-99ee-b8ce9838f91e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.500433] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.500433] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.500433] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.500433] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.500677] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.500781] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.500870] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.500919] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.501133] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.501215] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.501285] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 429d42d7-e5e7-4ade-9c7f-c5151648e98f already deleted. [ 913.501345] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.508056] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26df6822-523e-4c95-9d74-db0cddb065c0 in Status: SUCCESS [ 913.508392] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.703259] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.703447] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.703524] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.703968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.703968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.703968] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a is going to be updated. [ 913.734899] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.734995] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.735149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.735473] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.735600] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.763150] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: IN_PROGRESS for 2s [ 913.965590] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.965590] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.965590] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.965590] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.965590] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.966032] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 118ec609-3550-4cc4-99ee-b8ce9838f91e not found, creating... [ 913.966210] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.966375] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.966491] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.968050] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.968204] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.968506] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.968690] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.968775] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.969059] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.969365] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.969517] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 118ec609-3550-4cc4-99ee-b8ce9838f91e is going to be created. [ 913.985407] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 in Status: SUCCESS [ 913.985614] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 260ad733-0f5d-43fb-be04-c8ecbbbcea08 deletion is rescheduled due to dependency. [ 913.985715] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-260ad733-0f5d-43fb-be04-c8ecbbbcea08" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.995026] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.995302] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.995407] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.995801] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.996104] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.996718] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-118ec609-3550-4cc4-99ee-b8ce9838f91e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.751208] env[65322]: INFO networking_nsxv3.common.synchronization [req-314ba477-e8dc-4f12-a98e-553cfff1aab6 req-b651af01-03a1-46e5-a433-0d8c1bade5c8 service nova] Enqueued Resource ID: 429d42d7-e5e7-4ade-9c7f-c5151648e98f with Priority: HIGHEST for action security_group_rules [ 914.751380] env[65322]: INFO networking_nsxv3.common.synchronization [req-314ba477-e8dc-4f12-a98e-553cfff1aab6 req-b651af01-03a1-46e5-a433-0d8c1bade5c8 service nova] Enqueued Resource ID: 429d42d7-e5e7-4ade-9c7f-c5151648e98f with Priority: HIGHEST for action security_group_members [ 914.751455] env[65322]: INFO networking_nsxv3.common.synchronization [req-314ba477-e8dc-4f12-a98e-553cfff1aab6 req-b651af01-03a1-46e5-a433-0d8c1bade5c8 service nova] Enqueued Resource ID: 118ec609-3550-4cc4-99ee-b8ce9838f91e with Priority: HIGHEST for action port [ 914.752086] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 429d42d7-e5e7-4ade-9c7f-c5151648e98f with Priority: HIGHEST for action security_group_rules [ 914.752252] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 429d42d7-e5e7-4ade-9c7f-c5151648e98f with Priority: HIGHEST for action security_group_members [ 914.752315] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 118ec609-3550-4cc4-99ee-b8ce9838f91e with Priority: HIGHEST for action port [ 914.752644] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-429d42d7-e5e7-4ade-9c7f-c5151648e98f taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.752753] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.752753] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.753070] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.753070] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('429d42d7-e5e7-4ade-9c7f-c5151648e98f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.754065] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-429d42d7-e5e7-4ade-9c7f-c5151648e98f taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.754146] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.754201] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.754356] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.754497] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.754626] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.754713] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.754789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.754907] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.754959] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('429d42d7-e5e7-4ade-9c7f-c5151648e98f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.756146] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-118ec609-3550-4cc4-99ee-b8ce9838f91e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.756271] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-118ec609-3550-4cc4-99ee-b8ce9838f91e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.756324] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-118ec609-3550-4cc4-99ee-b8ce9838f91e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.756463] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-118ec609-3550-4cc4-99ee-b8ce9838f91e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.756529] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('118ec609-3550-4cc4-99ee-b8ce9838f91e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.259398] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('429d42d7-e5e7-4ade-9c7f-c5151648e98f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.261305] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-429d42d7-e5e7-4ade-9c7f-c5151648e98f taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.261305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.261305] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 118ec609-3550-4cc4-99ee-b8ce9838f91e with status ACTIVE [ 915.261561] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.261734] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.262046] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.262133] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.262767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.262767] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.262767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.262767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.262767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.263071] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.263832] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.263832] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.263832] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.263832] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.263832] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.263832] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 118ec609-3550-4cc4-99ee-b8ce9838f91e is going to be updated. [ 915.316921] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.317128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.317171] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.317362] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.317500] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.317666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-118ec609-3550-4cc4-99ee-b8ce9838f91e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.692391] env[65322]: INFO networking_nsxv3.common.synchronization [req-d69e4b80-a343-4013-8d24-5b9c83aa7155 req-35488de2-8154-4c85-8d25-6c2a133fa219 tempest-ServersNegativeTestJSON-1020115219 tempest-ServersNegativeTestJSON-1020115219-project-member] Enqueued Resource ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 with Priority: HIGHEST for action security_group_members [ 915.692994] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 with Priority: HIGHEST for action security_group_members [ 915.693324] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.693450] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.693507] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.693756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.693914] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.694028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.694082] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.694267] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.694354] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.694459] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.766437] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('429d42d7-e5e7-4ade-9c7f-c5151648e98f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.775020] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: SUCCESS [ 915.775495] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.776016] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.776769] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.777041] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.777409] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.777504] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.782991] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.782991] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.782991] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.782991] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.782991] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.782991] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.782991] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.782991] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.782991] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.782991] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.782991] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.782991] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.782991] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.782991] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.019672] env[65322]: INFO networking_nsxv3.common.synchronization [req-2b50c9e1-f721-4324-af59-ef0f0efeb818 req-0e541277-9b63-491d-9662-a72bca6fb44c tempest-DeleteServersTestJSON-1463403857 tempest-DeleteServersTestJSON-1463403857-project-member] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 916.020375] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 916.022030] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.022030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.022030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.022228] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.022380] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.022484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.022546] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.022753] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.022895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.023069] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.111994] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.112242] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-517" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.112381] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-517" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.112613] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-517" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.112923] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.113236] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.113400] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.113644] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.113890] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.114104] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 916.114222] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 916.114331] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 916.114445] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 916.114551] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 916.114654] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 916.114831] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 916.138170] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 916.138382] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 916.138509] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 916.138697] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-517" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.139047] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-1363292a-bd0a-4df1-a12e-a74e44ca8d16 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.139225] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-1363292a-bd0a-4df1-a12e-a74e44ca8d16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.139354] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-1363292a-bd0a-4df1-a12e-a74e44ca8d16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.139726] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-1363292a-bd0a-4df1-a12e-a74e44ca8d16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.139919] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1363292a-bd0a-4df1-a12e-a74e44ca8d16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.196417] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.272340] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.272655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.272655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.272768] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.272860] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.272959] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 429d42d7-e5e7-4ade-9c7f-c5151648e98f is going to be created. [ 916.283876] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef78971b-78bd-41bb-9a08-bdae7a3b226a: rpc.has_security_group_logging(os_id): False [ 916.310027] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.310234] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.310275] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.310646] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.310755] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.318214] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.318388] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.318425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.318633] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.318719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.318933] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.319051] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.319116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.319302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.319347] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.319509] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.319591] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.319649] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.319790] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.319865] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.320078] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.320187] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.320225] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.320358] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.320432] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.320513] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a is going to be created. [ 916.322411] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 429d42d7-e5e7-4ade-9c7f-c5151648e98f in Status: UNINITIALIZED for 2s [ 916.360153] env[65322]: INFO networking_nsxv3.common.synchronization [req-3429610a-91b5-4dc8-8c4a-9f65b05f4f82 req-b3768ef7-1ea5-4f45-b962-b5ea7dfdff0d tempest-ImagesTestJSON-2080608290 tempest-ImagesTestJSON-2080608290-project-member] Enqueued Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 916.361033] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 916.361284] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.361415] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.361488] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.361791] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.362250] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.362250] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.362396] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.362619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.362619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.362776] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.396074] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.396670] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.396751] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.396973] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.397182] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.410164] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: IN_PROGRESS for 2s [ 916.531944] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.531944] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.531944] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.531944] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.531944] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.531944] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.531944] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.531944] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.531944] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.531944] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.531944] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be updated. [ 916.559834] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.560032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.560076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.560434] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.560434] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.570477] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: IN_PROGRESS for 2s [ 916.646031] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.646031] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.646031] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.646031] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.646031] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.646031] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 1363292a-bd0a-4df1-a12e-a74e44ca8d16 not found, creating... [ 916.646031] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.646031] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.646031] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.646031] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.646031] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.646487] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.646487] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.646487] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.646487] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.646487] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.646996] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 1363292a-bd0a-4df1-a12e-a74e44ca8d16 is going to be created. [ 916.669525] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.670097] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.670350] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.670732] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.671083] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.671437] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-1363292a-bd0a-4df1-a12e-a74e44ca8d16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.700214] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.866118] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.201397] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.201619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.201815] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.202072] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.202170] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.202270] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 is going to be updated. [ 917.244834] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.244834] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.244834] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.244834] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.245102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.262448] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 in Status: IN_PROGRESS for 2s [ 917.369586] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.464721] env[65322]: INFO networking_nsxv3.common.synchronization [req-d69e4b80-a343-4013-8d24-5b9c83aa7155 req-b5fa20cd-1044-4eeb-a961-dc7e5de70c29 service nova] Enqueued Resource ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 with Priority: HIGHEST for action security_group_rules [ 917.465158] env[65322]: INFO networking_nsxv3.common.synchronization [req-d69e4b80-a343-4013-8d24-5b9c83aa7155 req-b5fa20cd-1044-4eeb-a961-dc7e5de70c29 service nova] Enqueued Resource ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 with Priority: HIGHEST for action security_group_members [ 917.465244] env[65322]: INFO networking_nsxv3.common.synchronization [req-d69e4b80-a343-4013-8d24-5b9c83aa7155 req-b5fa20cd-1044-4eeb-a961-dc7e5de70c29 service nova] Enqueued Resource ID: 1363292a-bd0a-4df1-a12e-a74e44ca8d16 with Priority: HIGHEST for action port [ 917.465916] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 with Priority: HIGHEST for action security_group_rules [ 917.466061] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 with Priority: HIGHEST for action security_group_members [ 917.466277] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1363292a-bd0a-4df1-a12e-a74e44ca8d16 with Priority: HIGHEST for action port [ 917.466523] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d8cdb67-7719-40d5-8ef7-63d3e76937f0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.466674] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.466749] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.466962] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.467666] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.469098] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.470166] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.470466] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-1363292a-bd0a-4df1-a12e-a74e44ca8d16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.470592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1363292a-bd0a-4df1-a12e-a74e44ca8d16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.470674] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1363292a-bd0a-4df1-a12e-a74e44ca8d16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.473168] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1363292a-bd0a-4df1-a12e-a74e44ca8d16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.473272] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1363292a-bd0a-4df1-a12e-a74e44ca8d16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.874836] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.874836] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.874836] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.874836] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.874836] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.874836] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 is going to be updated. [ 917.905594] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.905594] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.905594] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.905886] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.905947] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.915890] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: IN_PROGRESS for 2s [ 917.977818] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.977818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.980088] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1363292a-bd0a-4df1-a12e-a74e44ca8d16 with status ACTIVE [ 917.980287] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.980408] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.980470] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.980683] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.980767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.980940] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.981046] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.981107] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.981250] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.981917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.981917] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.981917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.981917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.981917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.981917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.981917] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1363292a-bd0a-4df1-a12e-a74e44ca8d16 is going to be updated. [ 918.014493] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.014657] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.014863] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.015013] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.015250] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.015448] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1363292a-bd0a-4df1-a12e-a74e44ca8d16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.333352] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 429d42d7-e5e7-4ade-9c7f-c5151648e98f in Status: SUCCESS [ 918.333589] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.333790] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.334062] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.334342] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.334716] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.334804] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.334974] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.335057] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.335150] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.335276] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('429d42d7-e5e7-4ade-9c7f-c5151648e98f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.424541] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: SUCCESS [ 918.424890] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.425040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.425262] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.425347] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.469183] env[65322]: INFO networking_nsxv3.common.synchronization [req-fe81a3e4-17d7-42d9-b39d-e67be19c1311 req-61383bbe-4549-4410-80f1-e1fdd54084a9 tempest-ServersAdminTestJSON-1989503110 tempest-ServersAdminTestJSON-1989503110-project-member] Enqueued Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_members [ 918.470053] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_members [ 918.470053] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.470053] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.470053] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.470264] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.470413] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.470531] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.470624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.471087] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.471087] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.471087] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.581658] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: SUCCESS [ 918.581866] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 deletion is rescheduled due to dependency. [ 918.581954] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.814632] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-174 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.816018] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-174" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.816018] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-174" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.816018] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-174" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.816594] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.817345] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.817345] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.820020] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.820020] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.820020] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 918.820020] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 918.820020] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 918.820020] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 918.820020] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 918.820020] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 918.820020] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 918.839311] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('429d42d7-e5e7-4ade-9c7f-c5151648e98f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.841246] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 918.841416] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 918.841553] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 918.841876] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-174" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.842211] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-93ca904a-04c3-45d4-9413-082075d77585 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.843025] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-93ca904a-04c3-45d4-9413-082075d77585" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.843025] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-93ca904a-04c3-45d4-9413-082075d77585" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.843025] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-93ca904a-04c3-45d4-9413-082075d77585" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.843025] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93ca904a-04c3-45d4-9413-082075d77585',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.929297] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.929744] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.929999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.930435] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.930731] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.930903] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.931069] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.931386] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.931612] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.931794] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.931992] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.973217] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.275650] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 in Status: SUCCESS [ 919.275853] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.276767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.276767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.276767] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.276767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.276767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.276996] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.277307] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.277307] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.339910] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 429d42d7-e5e7-4ade-9c7f-c5151648e98f: rpc.has_security_group_logging(os_id): False [ 919.345982] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.346154] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.346287] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.346573] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.346723] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.346911] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 93ca904a-04c3-45d4-9413-082075d77585 not found, creating... [ 919.347262] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.347334] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.347506] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.347688] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.347797] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.348091] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.348242] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.348355] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.348559] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.348688] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.348827] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 93ca904a-04c3-45d4-9413-082075d77585 is going to be created. [ 919.367137] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.367137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.367137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.367137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.367137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.367137] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.367137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.367137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.367137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.367137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.367137] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 429d42d7-e5e7-4ade-9c7f-c5151648e98f is going to be created. [ 919.370254] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.370877] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.370877] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.370971] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.371256] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.371472] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-93ca904a-04c3-45d4-9413-082075d77585" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.434701] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.435061] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.435061] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.435228] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.435412] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.435510] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.435573] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.435721] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.435811] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.435898] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.436129] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.436235] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.436294] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.436434] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.436558] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.436649] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.436710] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.436857] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.436948] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.437057] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.437163] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.442592] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.442748] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.442801] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.442939] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.443123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.467469] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 429d42d7-e5e7-4ade-9c7f-c5151648e98f in Status: IN_PROGRESS for 2s [ 919.475954] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.780979] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.929212] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: SUCCESS [ 919.929748] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.939743] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef78971b-78bd-41bb-9a08-bdae7a3b226a: rpc.has_security_group_logging(os_id): False [ 919.960091] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.960480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.960480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.960573] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.960631] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.960881] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.960986] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.961064] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.961230] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.961307] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.961481] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.961575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.961637] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.961797] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.961880] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.962573] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.962803] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.962905] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.963095] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.963207] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.963542] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a is going to be updated. [ 919.978851] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.978992] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.978992] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.979219] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.979300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.979393] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 is going to be updated. [ 919.981518] env[65322]: INFO networking_nsxv3.common.synchronization [req-1bda9266-9bd7-4629-bb2d-63e21d973050 req-4601822a-328b-4421-b557-60f044ee8e6e tempest-MultipleCreateTestJSON-731324011 tempest-MultipleCreateTestJSON-731324011-project-member] Enqueued Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_members [ 919.982097] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_members [ 919.982785] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.982949] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.983082] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.983293] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.983469] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.983590] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.983671] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.983955] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.984086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.984201] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.007876] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.008058] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.008115] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.009037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.009037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.020050] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: IN_PROGRESS for 2s [ 920.041377] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.041516] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.041573] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.041810] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.041968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.058480] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: IN_PROGRESS for 2s [ 920.176093] env[65322]: INFO networking_nsxv3.common.synchronization [req-fe81a3e4-17d7-42d9-b39d-e67be19c1311 req-124c144e-a81d-483d-aaa2-3ba2d814f4e2 service nova] Enqueued Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_rules [ 920.176210] env[65322]: INFO networking_nsxv3.common.synchronization [req-fe81a3e4-17d7-42d9-b39d-e67be19c1311 req-124c144e-a81d-483d-aaa2-3ba2d814f4e2 service nova] Enqueued Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_members [ 920.176396] env[65322]: INFO networking_nsxv3.common.synchronization [req-fe81a3e4-17d7-42d9-b39d-e67be19c1311 req-124c144e-a81d-483d-aaa2-3ba2d814f4e2 service nova] Enqueued Resource ID: 93ca904a-04c3-45d4-9413-082075d77585 with Priority: HIGHEST for action port [ 920.176892] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_rules [ 920.177028] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_members [ 920.177128] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ca904a-04c3-45d4-9413-082075d77585 with Priority: HIGHEST for action port [ 920.177431] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.177516] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.177587] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.177806] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.177862] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.179222] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.179222] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.179417] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-93ca904a-04c3-45d4-9413-082075d77585 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.179497] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93ca904a-04c3-45d4-9413-082075d77585" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.179497] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93ca904a-04c3-45d4-9413-082075d77585" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.179684] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93ca904a-04c3-45d4-9413-082075d77585" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.179775] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93ca904a-04c3-45d4-9413-082075d77585',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.285537] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.304937] env[65322]: INFO networking_nsxv3.common.synchronization [req-d671e5d6-2719-481a-ac30-136da73de5ec req-fc718e5f-5022-4cb4-846f-02c5b5a9c561 tempest-MultipleCreateTestJSON-731324011 tempest-MultipleCreateTestJSON-731324011-project-member] Enqueued Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_members [ 920.305944] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_members [ 920.306491] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.306615] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.486397] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.681494] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.682892] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.682892] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 93ca904a-04c3-45d4-9413-082075d77585 with status ACTIVE [ 920.682892] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.682892] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.682892] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.683201] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.683201] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.683343] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.683487] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.683545] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.683783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.683921] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.684140] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.684334] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.684334] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.684501] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.684690] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.684690] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 93ca904a-04c3-45d4-9413-082075d77585 is going to be updated. [ 920.723911] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.724147] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.724147] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.724346] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.724490] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.725351] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93ca904a-04c3-45d4-9413-082075d77585" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.791503] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.791503] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.791503] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.791503] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.791503] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.791503] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 is going to be updated. [ 920.840722] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.840722] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.840722] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.840943] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.842111] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.879327] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 in Status: IN_PROGRESS for 2s [ 920.988727] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.481558] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 429d42d7-e5e7-4ade-9c7f-c5151648e98f in Status: SUCCESS [ 921.481895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.491588] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.491859] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.491859] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.492026] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.492115] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.492218] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a is going to be updated. [ 921.521215] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.521528] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.521698] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.522011] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.522248] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.533074] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: IN_PROGRESS for 2s [ 922.033693] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: SUCCESS [ 922.033969] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.034482] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.034707] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.034891] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.035041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.035131] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.035278] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.035355] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.035447] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.074419] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: SUCCESS [ 922.074608] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.537820] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.890415] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 in Status: SUCCESS [ 922.891621] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.891621] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.891621] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.891621] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.891621] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.891621] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.891621] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.891621] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.891952] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.891952] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.040155] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.394829] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.394829] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.394829] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.394829] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.395284] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.395284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.395491] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.395839] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.395839] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.396183] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.396499] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.396709] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.396873] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.397204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.397495] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.397740] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.397876] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.398256] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.398540] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.398748] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.398947] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.545658] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: SUCCESS [ 923.546032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.546375] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.546502] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.546563] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.546822] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.546904] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.546960] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 is going to be updated. [ 923.548088] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.548269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.548437] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.548536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.548597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.548739] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.548815] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.548908] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.582059] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.583027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.583027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.583027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.583238] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.593707] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: IN_PROGRESS for 2s [ 923.901887] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d8cdb67-7719-40d5-8ef7-63d3e76937f0: rpc.has_security_group_logging(os_id): False [ 923.926605] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.926756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.926818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.927030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.927114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.927352] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.927439] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.927508] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.927618] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.927690] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.927909] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.927982] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.928046] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.928175] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.928249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.928439] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.928530] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.928588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.928719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.928788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.928868] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 is going to be updated. [ 924.009987] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.010787] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.010787] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.010787] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.010787] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.029741] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 in Status: IN_PROGRESS for 2s [ 924.051393] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.052292] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.052387] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.056025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.056025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.056025] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.056025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.056025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.056025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.056025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.056025] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a is going to be updated. [ 924.104545] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.105521] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.105521] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.106164] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.106164] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.118813] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: IN_PROGRESS for 2s [ 924.467674] env[65322]: INFO networking_nsxv3.common.synchronization [req-bf632a2e-6b96-4985-9a71-8c127019dab1 req-4ae2c074-3612-4f39-a56e-3dcb3c929ad7 tempest-AttachInterfacesTestJSON-353803948 tempest-AttachInterfacesTestJSON-353803948-project-member] Enqueued Resource ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 with Priority: HIGHEST for action security_group_members [ 924.467674] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 with Priority: HIGHEST for action security_group_members [ 924.467674] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.467674] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.467674] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.468290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.468531] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.468866] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.469092] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.469333] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.469535] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.469823] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9697a5d8-1fb8-45ef-a30e-a1b99942e3e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.826332] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-896 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.826741] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.826741] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.827046] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.827348] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.827499] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.827626] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.827860] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.828040] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.828249] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.828375] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 924.828492] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 924.828591] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 924.828708] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.829322] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 924.829322] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 924.849776] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 924.849952] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 924.850119] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 924.850297] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.850622] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-9daf5068-0e58-467b-a275-a8b0fe38248c taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.850794] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-9daf5068-0e58-467b-a275-a8b0fe38248c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.850911] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-9daf5068-0e58-467b-a275-a8b0fe38248c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.851284] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-9daf5068-0e58-467b-a275-a8b0fe38248c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.851420] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9daf5068-0e58-467b-a275-a8b0fe38248c',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.973945] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.973945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.973945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.973945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.973945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.973945] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.973945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.973945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.973945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.973945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.973945] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 already deleted. [ 924.973945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.360663] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.360894] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.361112] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.361310] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.361444] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.361594] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 9daf5068-0e58-467b-a275-a8b0fe38248c not found, creating... [ 925.361927] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.362108] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.362226] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.362600] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.362741] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.363037] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.363194] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.363309] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.363515] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.363642] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.363869] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 9daf5068-0e58-467b-a275-a8b0fe38248c is going to be created. [ 925.394244] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.394244] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.394244] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.394244] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.394244] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.394244] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-9daf5068-0e58-467b-a275-a8b0fe38248c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.604711] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: SUCCESS [ 925.604935] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.605090] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.605315] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.605561] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.605650] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.605757] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.606333] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.606333] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.606333] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.606333] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.047271] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 in Status: SUCCESS [ 926.047537] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.085481] env[65322]: INFO networking_nsxv3.common.synchronization [req-bf632a2e-6b96-4985-9a71-8c127019dab1 req-fb67c4b7-723b-4225-9dc2-b6d602d6725b service nova] Enqueued Resource ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 with Priority: HIGHEST for action security_group_rules [ 926.086184] env[65322]: INFO networking_nsxv3.common.synchronization [req-bf632a2e-6b96-4985-9a71-8c127019dab1 req-fb67c4b7-723b-4225-9dc2-b6d602d6725b service nova] Enqueued Resource ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 with Priority: HIGHEST for action security_group_members [ 926.086184] env[65322]: INFO networking_nsxv3.common.synchronization [req-bf632a2e-6b96-4985-9a71-8c127019dab1 req-fb67c4b7-723b-4225-9dc2-b6d602d6725b service nova] Enqueued Resource ID: 9daf5068-0e58-467b-a275-a8b0fe38248c with Priority: HIGHEST for action port [ 926.086426] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 with Priority: HIGHEST for action security_group_rules [ 926.086575] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 with Priority: HIGHEST for action security_group_members [ 926.086669] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9daf5068-0e58-467b-a275-a8b0fe38248c with Priority: HIGHEST for action port [ 926.086977] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.087204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.087204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.087404] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.087446] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9697a5d8-1fb8-45ef-a30e-a1b99942e3e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.088366] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.088452] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.088517] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.088688] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.088879] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.088948] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.088996] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.089139] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.089230] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.089358] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9697a5d8-1fb8-45ef-a30e-a1b99942e3e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.090251] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-9daf5068-0e58-467b-a275-a8b0fe38248c taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.090350] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9daf5068-0e58-467b-a275-a8b0fe38248c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.090897] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9daf5068-0e58-467b-a275-a8b0fe38248c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.090897] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9daf5068-0e58-467b-a275-a8b0fe38248c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.090897] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9daf5068-0e58-467b-a275-a8b0fe38248c',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.108827] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.108827] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.108990] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.109221] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.109452] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.109596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.109693] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.110233] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.110233] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.110233] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.110360] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.110493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.110551] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.110718] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.110909] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.111016] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.111421] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.111421] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.111421] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.111540] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.111645] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.129692] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: SUCCESS [ 926.129928] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a deletion is rescheduled due to dependency. [ 926.130061] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.592374] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9697a5d8-1fb8-45ef-a30e-a1b99942e3e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.593375] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.593484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.594843] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9daf5068-0e58-467b-a275-a8b0fe38248c with status ACTIVE [ 926.595068] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.595192] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.595277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.595477] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.595561] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.595774] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.595874] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.595936] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.596103] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.596178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.596357] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.596449] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.596567] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.596712] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.596785] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.596911] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9daf5068-0e58-467b-a275-a8b0fe38248c is going to be updated. [ 926.614686] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ed63561-0704-4a50-8dc8-a078d5c0c6f3: rpc.has_security_group_logging(os_id): False [ 926.618205] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.618376] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.618433] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.618601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.618727] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.618887] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9daf5068-0e58-467b-a275-a8b0fe38248c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.631897] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.632195] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.632195] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.632329] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.632422] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.632596] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.632692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.632754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.632896] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.632968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.633182] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.633275] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.633327] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.633466] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.633588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.633743] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.633894] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.633956] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.634142] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.634214] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.634285] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 is going to be updated. [ 926.711815] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.711992] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.712106] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.712346] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.712828] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.733122] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: IN_PROGRESS for 2s [ 927.098759] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9697a5d8-1fb8-45ef-a30e-a1b99942e3e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.500322] env[65322]: INFO networking_nsxv3.common.synchronization [req-1aa95161-ed07-4ded-b965-d0eabd8aa87b req-6d85949f-cc2e-401a-a837-060f44418d47 tempest-ServersNegativeTestJSON-1020115219 tempest-ServersNegativeTestJSON-1020115219-project-member] Enqueued Resource ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 with Priority: HIGHEST for action security_group_members [ 927.500845] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 with Priority: HIGHEST for action security_group_members [ 927.501154] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.501274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.501343] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.501542] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.501914] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.502031] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.502119] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.502252] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.502328] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.502423] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.602063] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.602216] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.602284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.602516] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.602584] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.602683] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 is going to be created. [ 927.628981] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.628981] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.628981] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.628981] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.628981] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.638308] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 in Status: UNINITIALIZED for 2s [ 928.007603] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.509159] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.747739] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: SUCCESS [ 928.748201] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.016377] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.016377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.016377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.016377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.016377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.016377] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 is going to be updated. [ 929.050496] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.050496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.050783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.050783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.050939] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.063546] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 in Status: IN_PROGRESS for 2s [ 929.562639] env[65322]: INFO networking_nsxv3.common.synchronization [None req-f7c55b02-fafe-4527-a875-4a7d7e549283 None None] Enqueued Resource ID: dd531a08-ee6c-40e3-8636-5de1ad4492f2 with Priority: HIGHEST for action port [ 929.562639] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd531a08-ee6c-40e3-8636-5de1ad4492f2 with Priority: HIGHEST for action port [ 929.563067] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd531a08-ee6c-40e3-8636-5de1ad4492f2 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.563067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd531a08-ee6c-40e3-8636-5de1ad4492f2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.563067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd531a08-ee6c-40e3-8636-5de1ad4492f2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.563232] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd531a08-ee6c-40e3-8636-5de1ad4492f2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.563749] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd531a08-ee6c-40e3-8636-5de1ad4492f2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.648667] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 in Status: SUCCESS [ 929.648880] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.649056] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.649268] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.650092] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.650092] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.650092] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.650092] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.650092] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.650092] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.650092] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9697a5d8-1fb8-45ef-a30e-a1b99942e3e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.065691] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd531a08-ee6c-40e3-8636-5de1ad4492f2 [ 930.065691] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.065932] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.065932] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.066216] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.066404] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.066531] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd531a08-ee6c-40e3-8636-5de1ad4492f2 already deleted. [ 930.066626] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd531a08-ee6c-40e3-8636-5de1ad4492f2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.153208] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9697a5d8-1fb8-45ef-a30e-a1b99942e3e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.656648] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8: rpc.has_security_group_logging(os_id): False [ 930.678614] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.678800] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.678856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.679055] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.679148] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.679385] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.679480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.679542] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.679694] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.679768] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.679855] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 is going to be created. [ 930.765772] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.766037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.766165] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.766446] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.766972] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.785532] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 in Status: IN_PROGRESS for 2s [ 931.075123] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 in Status: SUCCESS [ 931.075364] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.003589] env[65322]: INFO networking_nsxv3.common.synchronization [None req-33fbdbfe-7a34-40ca-a7e3-526765b75759 None None] Enqueued Resource ID: 242a5305-d6d2-4269-aa97-1a1c9fc93843 with Priority: HIGHEST for action port [ 932.006776] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 242a5305-d6d2-4269-aa97-1a1c9fc93843 with Priority: HIGHEST for action port [ 932.007189] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-242a5305-d6d2-4269-aa97-1a1c9fc93843 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.007372] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-242a5305-d6d2-4269-aa97-1a1c9fc93843" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.007405] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-242a5305-d6d2-4269-aa97-1a1c9fc93843" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.007646] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-242a5305-d6d2-4269-aa97-1a1c9fc93843" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.007731] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('242a5305-d6d2-4269-aa97-1a1c9fc93843',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.439720] env[65322]: INFO networking_nsxv3.common.synchronization [None req-4b0bd7b2-121a-46b3-afcf-1277a53ea2b2 None None] Enqueued Resource ID: df5ca285-c310-4f24-af98-22273203b47e with Priority: HIGHEST for action port [ 932.440715] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df5ca285-c310-4f24-af98-22273203b47e with Priority: HIGHEST for action port [ 932.440715] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-df5ca285-c310-4f24-af98-22273203b47e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.440715] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df5ca285-c310-4f24-af98-22273203b47e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.440715] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df5ca285-c310-4f24-af98-22273203b47e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.441322] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df5ca285-c310-4f24-af98-22273203b47e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.441322] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df5ca285-c310-4f24-af98-22273203b47e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.511038] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 242a5305-d6d2-4269-aa97-1a1c9fc93843 [ 932.511654] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.511654] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.511654] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.511654] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.511851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.511851] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:242a5305-d6d2-4269-aa97-1a1c9fc93843 already deleted. [ 932.512057] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-242a5305-d6d2-4269-aa97-1a1c9fc93843" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.801301] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 in Status: SUCCESS [ 932.802268] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.943596] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df5ca285-c310-4f24-af98-22273203b47e [ 932.943596] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.943596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.943596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.943596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.943596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.943596] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df5ca285-c310-4f24-af98-22273203b47e already deleted. [ 932.943596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df5ca285-c310-4f24-af98-22273203b47e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.704223] env[65322]: INFO networking_nsxv3.common.synchronization [req-a79718a2-89c2-4c72-8d54-ec375028732f req-a475cc0a-d8ee-4c87-8d5a-2e7c83867c5f tempest-ServerActionsTestOtherA-1162989957 tempest-ServerActionsTestOtherA-1162989957-project-member] Enqueued Resource ID: 67117db1-586f-43f8-920a-dd7b8767d9ec with Priority: HIGHEST for action security_group_members [ 934.704883] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67117db1-586f-43f8-920a-dd7b8767d9ec with Priority: HIGHEST for action security_group_members [ 934.705165] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-67117db1-586f-43f8-920a-dd7b8767d9ec taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.705283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.705346] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.705602] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.705746] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.705931] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.705931] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.706048] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.706123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.706269] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67117db1-586f-43f8-920a-dd7b8767d9ec',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.808373] env[65322]: INFO networking_nsxv3.common.synchronization [None req-c46cb9fb-e95f-472f-9c0f-f3ef53e21853 None None] Enqueued Resource ID: 593060cb-a24d-43ab-92ab-6ca9474425b3 with Priority: HIGHEST for action port [ 934.808373] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 593060cb-a24d-43ab-92ab-6ca9474425b3 with Priority: HIGHEST for action port [ 934.809191] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-593060cb-a24d-43ab-92ab-6ca9474425b3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.809191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-593060cb-a24d-43ab-92ab-6ca9474425b3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.809191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-593060cb-a24d-43ab-92ab-6ca9474425b3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.811419] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-593060cb-a24d-43ab-92ab-6ca9474425b3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.811523] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('593060cb-a24d-43ab-92ab-6ca9474425b3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.076847] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-315 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.077061] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-315" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.077190] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-315" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.077461] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-315" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.077736] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.078381] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.078381] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.078381] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.078381] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.078576] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 935.078613] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 935.078755] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 935.079016] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 935.079016] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 935.079128] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 935.080270] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 935.100848] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 935.101048] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 935.101217] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 935.101399] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-315" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.101820] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-7d8d2a04-b506-49a5-95d4-e2e2a4594047 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.101960] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-7d8d2a04-b506-49a5-95d4-e2e2a4594047" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.102159] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-7d8d2a04-b506-49a5-95d4-e2e2a4594047" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.102651] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-7d8d2a04-b506-49a5-95d4-e2e2a4594047" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.102761] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d8d2a04-b506-49a5-95d4-e2e2a4594047',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.208060] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.208060] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.208244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.208355] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.208450] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.208640] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.208737] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.208797] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.208957] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.209067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.209154] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67117db1-586f-43f8-920a-dd7b8767d9ec already deleted. [ 935.209269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.263603] env[65322]: INFO networking_nsxv3.common.synchronization [None req-e222c630-45ad-441e-a741-a86e965fc938 None None] Enqueued Resource ID: 89516bd2-765d-4e6f-a5ae-a06eab820dae with Priority: HIGHEST for action port [ 935.264286] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89516bd2-765d-4e6f-a5ae-a06eab820dae with Priority: HIGHEST for action port [ 935.264829] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-89516bd2-765d-4e6f-a5ae-a06eab820dae taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.264829] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89516bd2-765d-4e6f-a5ae-a06eab820dae" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.264829] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89516bd2-765d-4e6f-a5ae-a06eab820dae" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.265208] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89516bd2-765d-4e6f-a5ae-a06eab820dae" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.265307] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89516bd2-765d-4e6f-a5ae-a06eab820dae',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.319450] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 593060cb-a24d-43ab-92ab-6ca9474425b3 [ 935.319697] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.319829] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.319898] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.320154] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.320248] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.320348] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:593060cb-a24d-43ab-92ab-6ca9474425b3 already deleted. [ 935.320428] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-593060cb-a24d-43ab-92ab-6ca9474425b3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.604846] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.605123] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.605273] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.605576] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.605728] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.605895] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 7d8d2a04-b506-49a5-95d4-e2e2a4594047 not found, creating... [ 935.606214] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.606335] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.606449] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.606672] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.606807] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.607100] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.607263] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.607397] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.607607] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.607737] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.607874] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 7d8d2a04-b506-49a5-95d4-e2e2a4594047 is going to be created. [ 935.630517] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.630678] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.630778] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.631082] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.631310] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.631618] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-7d8d2a04-b506-49a5-95d4-e2e2a4594047" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.770380] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 89516bd2-765d-4e6f-a5ae-a06eab820dae [ 935.770380] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.770380] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.770380] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.770380] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.770380] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.770380] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:89516bd2-765d-4e6f-a5ae-a06eab820dae already deleted. [ 935.770380] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89516bd2-765d-4e6f-a5ae-a06eab820dae" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.391554] env[65322]: INFO networking_nsxv3.common.synchronization [req-a79718a2-89c2-4c72-8d54-ec375028732f req-47a155c4-2a57-4119-9889-64dc3e41362a service nova] Enqueued Resource ID: 67117db1-586f-43f8-920a-dd7b8767d9ec with Priority: HIGHEST for action security_group_rules [ 936.391554] env[65322]: INFO networking_nsxv3.common.synchronization [req-a79718a2-89c2-4c72-8d54-ec375028732f req-47a155c4-2a57-4119-9889-64dc3e41362a service nova] Enqueued Resource ID: 67117db1-586f-43f8-920a-dd7b8767d9ec with Priority: HIGHEST for action security_group_members [ 936.391554] env[65322]: INFO networking_nsxv3.common.synchronization [req-a79718a2-89c2-4c72-8d54-ec375028732f req-47a155c4-2a57-4119-9889-64dc3e41362a service nova] Enqueued Resource ID: 7d8d2a04-b506-49a5-95d4-e2e2a4594047 with Priority: HIGHEST for action port [ 936.391554] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67117db1-586f-43f8-920a-dd7b8767d9ec with Priority: HIGHEST for action security_group_rules [ 936.391554] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67117db1-586f-43f8-920a-dd7b8767d9ec with Priority: HIGHEST for action security_group_members [ 936.391554] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d8d2a04-b506-49a5-95d4-e2e2a4594047 with Priority: HIGHEST for action port [ 936.392158] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67117db1-586f-43f8-920a-dd7b8767d9ec taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.392158] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.392270] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.392376] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.392457] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67117db1-586f-43f8-920a-dd7b8767d9ec',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.393358] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-67117db1-586f-43f8-920a-dd7b8767d9ec taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.393599] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.393599] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.393685] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.393827] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.393956] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.393995] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.394513] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.394513] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.394513] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67117db1-586f-43f8-920a-dd7b8767d9ec',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.395437] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d8d2a04-b506-49a5-95d4-e2e2a4594047 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.395437] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d8d2a04-b506-49a5-95d4-e2e2a4594047" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.395437] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d8d2a04-b506-49a5-95d4-e2e2a4594047" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.395564] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d8d2a04-b506-49a5-95d4-e2e2a4594047" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.395793] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d8d2a04-b506-49a5-95d4-e2e2a4594047',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.897679] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('67117db1-586f-43f8-920a-dd7b8767d9ec',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.900660] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-67117db1-586f-43f8-920a-dd7b8767d9ec taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.900660] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.901156] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d8d2a04-b506-49a5-95d4-e2e2a4594047 with status ACTIVE [ 936.901156] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.901156] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.901156] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.901365] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.901365] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.901604] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.901684] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.901684] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.902435] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.902435] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.902435] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.902435] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.902435] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.902435] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.902435] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.902731] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d8d2a04-b506-49a5-95d4-e2e2a4594047 is going to be updated. [ 936.937543] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.937543] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.937543] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.937941] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.937941] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.937941] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d8d2a04-b506-49a5-95d4-e2e2a4594047" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.069062] env[65322]: INFO networking_nsxv3.common.synchronization [req-1fb1b23f-47a5-4c6a-8930-41fbd61bce44 req-2f823a1c-ee15-4752-ad04-d3f43c293924 tempest-ServersAdminNegativeTestJSON-636642581 tempest-ServersAdminNegativeTestJSON-636642581-project-member] Enqueued Resource ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 with Priority: HIGHEST for action security_group_members [ 937.069652] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 with Priority: HIGHEST for action security_group_members [ 937.069956] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-dae95ed3-e249-4093-bc1a-6e3471cc5953 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.070704] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.070798] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.071031] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.071220] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.071340] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.071402] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.072344] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.072344] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.072344] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dae95ed3-e249-4093-bc1a-6e3471cc5953',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.341191] env[65322]: INFO networking_nsxv3.common.synchronization [None req-3e5565b1-2e11-479e-bc01-a93c2a876f1c None None] Enqueued Resource ID: 267e055f-6f8d-4703-8c7d-1dc898899004 with Priority: HIGHEST for action port [ 937.341191] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 267e055f-6f8d-4703-8c7d-1dc898899004 with Priority: HIGHEST for action port [ 937.341191] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-267e055f-6f8d-4703-8c7d-1dc898899004 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.341191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-267e055f-6f8d-4703-8c7d-1dc898899004" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.341191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-267e055f-6f8d-4703-8c7d-1dc898899004" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.341655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-267e055f-6f8d-4703-8c7d-1dc898899004" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.341864] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('267e055f-6f8d-4703-8c7d-1dc898899004',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.401405] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('67117db1-586f-43f8-920a-dd7b8767d9ec',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.506583] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-620 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.506583] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.506583] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.506583] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.506872] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.507646] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.507646] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.507646] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.507646] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.507646] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.507864] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 937.507864] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 937.508055] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 937.508211] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.508327] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 937.508455] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 937.529285] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 937.531315] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 937.531315] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 937.531315] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.531315] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-0594b3c1-a549-493c-adad-64462a02c85d taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.531315] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-0594b3c1-a549-493c-adad-64462a02c85d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.531315] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-0594b3c1-a549-493c-adad-64462a02c85d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.531315] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-0594b3c1-a549-493c-adad-64462a02c85d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.531315] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0594b3c1-a549-493c-adad-64462a02c85d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.576785] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dae95ed3-e249-4093-bc1a-6e3471cc5953',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.847049] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 267e055f-6f8d-4703-8c7d-1dc898899004 [ 937.847296] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.847428] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.847496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.847723] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.847806] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.847897] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:267e055f-6f8d-4703-8c7d-1dc898899004 already deleted. [ 937.847978] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-267e055f-6f8d-4703-8c7d-1dc898899004" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.904572] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.905018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.905018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.905146] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.905216] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.905285] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67117db1-586f-43f8-920a-dd7b8767d9ec is going to be created. [ 937.931530] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.931722] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.931722] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.931925] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.932138] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.945095] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67117db1-586f-43f8-920a-dd7b8767d9ec in Status: UNINITIALIZED for 2s [ 938.034525] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.034760] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.034886] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.035212] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.035357] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.035513] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 0594b3c1-a549-493c-adad-64462a02c85d not found, creating... [ 938.035776] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.035930] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.036070] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.036662] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.036662] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.036898] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.036898] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.036997] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.037149] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.037277] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.037456] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 0594b3c1-a549-493c-adad-64462a02c85d is going to be created. [ 938.061301] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.062061] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.062061] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.062061] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.062365] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.062365] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-0594b3c1-a549-493c-adad-64462a02c85d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.078387] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dae95ed3-e249-4093-bc1a-6e3471cc5953',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.582035] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.582035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.582035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.582035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.582035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.582035] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 is going to be updated. [ 938.610060] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.610233] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.610233] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.611034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.611034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.621574] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 in Status: IN_PROGRESS for 2s [ 938.780141] env[65322]: INFO networking_nsxv3.common.synchronization [req-1fb1b23f-47a5-4c6a-8930-41fbd61bce44 req-76d8784c-6542-4bdb-b7a9-2c04564a8c4a service nova] Enqueued Resource ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 with Priority: HIGHEST for action security_group_rules [ 938.780360] env[65322]: INFO networking_nsxv3.common.synchronization [req-1fb1b23f-47a5-4c6a-8930-41fbd61bce44 req-76d8784c-6542-4bdb-b7a9-2c04564a8c4a service nova] Enqueued Resource ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 with Priority: HIGHEST for action security_group_members [ 938.780533] env[65322]: INFO networking_nsxv3.common.synchronization [req-1fb1b23f-47a5-4c6a-8930-41fbd61bce44 req-76d8784c-6542-4bdb-b7a9-2c04564a8c4a service nova] Enqueued Resource ID: 0594b3c1-a549-493c-adad-64462a02c85d with Priority: HIGHEST for action port [ 938.781236] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 with Priority: HIGHEST for action security_group_rules [ 938.781407] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 with Priority: HIGHEST for action security_group_members [ 938.781534] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0594b3c1-a549-493c-adad-64462a02c85d with Priority: HIGHEST for action port [ 938.781851] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dae95ed3-e249-4093-bc1a-6e3471cc5953 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.781994] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.782079] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.782328] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.782415] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dae95ed3-e249-4093-bc1a-6e3471cc5953',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.783894] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-dae95ed3-e249-4093-bc1a-6e3471cc5953 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.784079] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.784593] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-0594b3c1-a549-493c-adad-64462a02c85d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.784593] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0594b3c1-a549-493c-adad-64462a02c85d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.784593] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0594b3c1-a549-493c-adad-64462a02c85d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.784760] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0594b3c1-a549-493c-adad-64462a02c85d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.785077] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0594b3c1-a549-493c-adad-64462a02c85d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.287354] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-dae95ed3-e249-4093-bc1a-6e3471cc5953 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.289430] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.289430] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0594b3c1-a549-493c-adad-64462a02c85d with status ACTIVE [ 939.289430] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.289430] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.289430] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.289430] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.289430] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.289430] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.289430] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.289430] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.290041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.290184] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.290494] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.290661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.290761] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.290959] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.291097] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.291256] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0594b3c1-a549-493c-adad-64462a02c85d is going to be updated. [ 939.320813] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.321016] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.321258] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.321354] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.321867] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.321867] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0594b3c1-a549-493c-adad-64462a02c85d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.494217] env[65322]: INFO networking_nsxv3.common.synchronization [req-596fc60f-4529-4eb4-98b6-6c673b8ee406 req-eb821357-e70e-4320-9f7b-a729f6a15070 tempest-ServerActionsTestOtherB-30032286 tempest-ServerActionsTestOtherB-30032286-project-member] Enqueued Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_members [ 939.494217] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_members [ 939.494217] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-c552e7e9-dc55-4efc-afb8-91a443d0679a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.494217] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.494217] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.494577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.494577] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.494577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.494700] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.495137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.495231] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.495323] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.962028] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67117db1-586f-43f8-920a-dd7b8767d9ec in Status: SUCCESS [ 939.962028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.962028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.962028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.962471] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.962471] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.962471] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.962471] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.962471] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.962650] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.962650] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('67117db1-586f-43f8-920a-dd7b8767d9ec',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.997869] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.998109] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.998463] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.998463] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.020583] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.020842] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.021048] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.021149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.021392] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.021473] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.021563] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c552e7e9-dc55-4efc-afb8-91a443d0679a is going to be updated. [ 940.051715] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.051879] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.052039] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.053232] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.053232] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.062280] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: IN_PROGRESS for 2s [ 940.468330] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('67117db1-586f-43f8-920a-dd7b8767d9ec',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.631748] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 in Status: SUCCESS [ 940.631982] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.632086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.633075] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.633075] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.633075] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.633075] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.633075] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.633075] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.633075] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dae95ed3-e249-4093-bc1a-6e3471cc5953',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.970520] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 67117db1-586f-43f8-920a-dd7b8767d9ec: rpc.has_security_group_logging(os_id): False [ 940.990526] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.990526] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.990526] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.990756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.990801] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.991110] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.991280] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.991280] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.991805] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.991805] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.991805] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67117db1-586f-43f8-920a-dd7b8767d9ec is going to be created. [ 941.054425] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.054587] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.054670] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.055406] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.055406] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.067018] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67117db1-586f-43f8-920a-dd7b8767d9ec in Status: IN_PROGRESS for 2s [ 941.135658] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dae95ed3-e249-4093-bc1a-6e3471cc5953',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.641232] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dae95ed3-e249-4093-bc1a-6e3471cc5953',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.073774] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: SUCCESS [ 942.073933] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c552e7e9-dc55-4efc-afb8-91a443d0679a deletion is rescheduled due to dependency. [ 942.074577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.146597] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.146787] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.146863] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.147179] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.147293] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.147413] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 is going to be updated. [ 942.189244] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.189384] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.189471] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.189663] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.189838] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.200596] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 in Status: IN_PROGRESS for 2s [ 943.081375] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67117db1-586f-43f8-920a-dd7b8767d9ec in Status: SUCCESS [ 943.082162] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.215938] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 in Status: SUCCESS [ 944.215938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.215938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.215938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.215938] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.215938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.215938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.215938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.215938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.215938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.215938] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dae95ed3-e249-4093-bc1a-6e3471cc5953',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.299263] env[65322]: INFO networking_nsxv3.common.synchronization [req-99ee2c2b-1f18-47eb-83e3-8e1222b6b576 req-2aa7dfea-6e33-4209-9631-a169355c8837 tempest-MigrationsAdminTest-1504175931 tempest-MigrationsAdminTest-1504175931-project-member] Enqueued Resource ID: 26df6822-523e-4c95-9d74-db0cddb065c0 with Priority: HIGHEST for action security_group_members [ 944.300987] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26df6822-523e-4c95-9d74-db0cddb065c0 with Priority: HIGHEST for action security_group_members [ 944.301525] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-26df6822-523e-4c95-9d74-db0cddb065c0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.301638] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.301741] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.302053] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.302343] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.302472] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.302472] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.302621] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.302705] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.302800] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('26df6822-523e-4c95-9d74-db0cddb065c0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.718676] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-dae95ed3-e249-4093-bc1a-6e3471cc5953 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.718676] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.718676] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.718898] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.719089] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.719490] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.719560] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.722445] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.722445] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.722445] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.722445] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-dae95ed3-e249-4093-bc1a-6e3471cc5953 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.722445] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.722445] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.722445] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.722445] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.722445] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.722445] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.722445] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.722445] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.722445] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.722445] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dae95ed3-e249-4093-bc1a-6e3471cc5953',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.811940] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.812196] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.812196] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.812424] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.812515] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.812718] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.812818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.812880] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.813074] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.813132] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.813197] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26df6822-523e-4c95-9d74-db0cddb065c0 is going to be updated. [ 944.852316] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.852464] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.852534] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.852750] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.852889] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.865559] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26df6822-523e-4c95-9d74-db0cddb065c0 in Status: IN_PROGRESS for 2s [ 945.224101] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dae95ed3-e249-4093-bc1a-6e3471cc5953: rpc.has_security_group_logging(os_id): False [ 945.244820] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.245157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.245157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.245259] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.245343] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.245541] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.245638] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.245695] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.245854] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.245970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.246221] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.246479] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.246545] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.246705] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.246786] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.246999] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.247118] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.247245] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.247326] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.247544] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.247544] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 is going to be updated. [ 945.347972] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.348150] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.348233] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.348461] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.348659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.371236] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 in Status: IN_PROGRESS for 2s [ 946.877834] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 26df6822-523e-4c95-9d74-db0cddb065c0 in Status: SUCCESS [ 946.877834] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 26df6822-523e-4c95-9d74-db0cddb065c0 deletion is rescheduled due to dependency. [ 946.877834] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.403681] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 in Status: SUCCESS [ 947.404169] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.303887] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 949.303887] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 951.489103] env[65322]: INFO networking_nsxv3.common.synchronization [req-00137144-36f7-42eb-91de-f69c732ddc98 req-eb6f2c38-f981-4aec-b122-9cda126dfeb3 tempest-ImagesTestJSON-2080608290 tempest-ImagesTestJSON-2080608290-project-member] Enqueued Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 951.490742] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 951.490742] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.490742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.490742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.490742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.490742] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.490742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.490742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.491983] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.491983] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.491983] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.993558] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.996427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.996427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.996427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.996427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.996427] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.996427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.996427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.996427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.996427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.996427] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 is going to be updated. [ 952.035999] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.035999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.035999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.036340] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.036340] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.047480] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: IN_PROGRESS for 2s [ 954.058477] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: SUCCESS [ 954.058788] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 deletion is rescheduled due to dependency. [ 954.058788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.565305] env[65322]: INFO networking_nsxv3.common.synchronization [req-ce49a08a-1988-4b1a-b2d9-3c30d326d680 req-55f2a02c-e057-4618-bc84-aafc4eebf3a2 tempest-ServersAdminNegativeTestJSON-636642581 tempest-ServersAdminNegativeTestJSON-636642581-project-member] Enqueued Resource ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 with Priority: HIGHEST for action security_group_members [ 954.566041] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 with Priority: HIGHEST for action security_group_members [ 954.569599] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-dae95ed3-e249-4093-bc1a-6e3471cc5953 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.569777] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.569851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.570069] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.570250] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.570354] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.570416] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.570564] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.570649] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.570743] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dae95ed3-e249-4093-bc1a-6e3471cc5953',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.073591] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dae95ed3-e249-4093-bc1a-6e3471cc5953',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.576366] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dae95ed3-e249-4093-bc1a-6e3471cc5953',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.078851] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.079514] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.079514] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.079514] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.079514] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.079514] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 is going to be updated. [ 956.108343] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.108535] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.108692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.108938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.108938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.119078] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 in Status: IN_PROGRESS for 2s [ 957.511790] env[65322]: INFO networking_nsxv3.common.synchronization [req-360a6f51-e041-4e94-8a37-e6d087130488 req-5399ebd3-e59b-4912-b7de-fc401937c241 tempest-ImagesOneServerNegativeTestJSON-1972759635 tempest-ImagesOneServerNegativeTestJSON-1972759635-project-member] Enqueued Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGHEST for action security_group_members [ 957.513378] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGHEST for action security_group_members [ 957.514182] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1550bb0-c88b-4864-824e-b80ca3b52834 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.514621] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.514891] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.515424] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.515863] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.516251] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.516538] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.516981] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.517387] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.517801] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.860483] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-139 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.860625] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-139" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.860681] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-139" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.861009] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-139" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.861265] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.861419] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.861530] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.862191] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.862423] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.862647] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 957.862766] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 957.862878] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 957.862983] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 957.863112] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 957.863509] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 957.863509] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 957.889517] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 957.889517] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 957.889517] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 957.889918] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-139" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.890140] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-23511995-eb19-4ebe-9079-fa7fb2a98d67 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.890140] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-23511995-eb19-4ebe-9079-fa7fb2a98d67" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.890330] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-23511995-eb19-4ebe-9079-fa7fb2a98d67" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.890559] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-23511995-eb19-4ebe-9079-fa7fb2a98d67" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.890834] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23511995-eb19-4ebe-9079-fa7fb2a98d67',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.020914] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.021155] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.021287] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.021586] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.025035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.025035] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.025035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.025035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.025035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.025035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.025035] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1550bb0-c88b-4864-824e-b80ca3b52834 is going to be updated. [ 958.054357] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.054556] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.054556] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.054676] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.054820] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.065392] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1550bb0-c88b-4864-824e-b80ca3b52834 in Status: IN_PROGRESS for 2s [ 958.128595] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 in Status: SUCCESS [ 958.128823] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.392950] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.393176] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.393306] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.393588] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.393731] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.393881] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 23511995-eb19-4ebe-9079-fa7fb2a98d67 not found, creating... [ 958.394204] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.394360] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.394475] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.394691] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.394825] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.395113] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.395265] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.395374] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.395576] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.395702] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.395837] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 23511995-eb19-4ebe-9079-fa7fb2a98d67 is going to be created. [ 958.419800] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.420021] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.420130] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.420412] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.420919] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.420919] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-23511995-eb19-4ebe-9079-fa7fb2a98d67" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.125757] env[65322]: INFO networking_nsxv3.common.synchronization [req-360a6f51-e041-4e94-8a37-e6d087130488 req-f1b920a6-259c-4b29-881b-7a041a49f0b9 service nova] Enqueued Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGHEST for action security_group_rules [ 959.126048] env[65322]: INFO networking_nsxv3.common.synchronization [req-360a6f51-e041-4e94-8a37-e6d087130488 req-f1b920a6-259c-4b29-881b-7a041a49f0b9 service nova] Enqueued Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGHEST for action security_group_members [ 959.126101] env[65322]: INFO networking_nsxv3.common.synchronization [req-360a6f51-e041-4e94-8a37-e6d087130488 req-f1b920a6-259c-4b29-881b-7a041a49f0b9 service nova] Enqueued Resource ID: 23511995-eb19-4ebe-9079-fa7fb2a98d67 with Priority: HIGHEST for action port [ 959.126613] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGHEST for action security_group_rules [ 959.126746] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGHEST for action security_group_members [ 959.126836] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23511995-eb19-4ebe-9079-fa7fb2a98d67 with Priority: HIGHEST for action port [ 959.128830] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1550bb0-c88b-4864-824e-b80ca3b52834 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.128830] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.128830] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.129075] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.129075] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.130099] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1550bb0-c88b-4864-824e-b80ca3b52834 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.130099] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.130461] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-23511995-eb19-4ebe-9079-fa7fb2a98d67 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.130534] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23511995-eb19-4ebe-9079-fa7fb2a98d67" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.130596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23511995-eb19-4ebe-9079-fa7fb2a98d67" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.130972] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23511995-eb19-4ebe-9079-fa7fb2a98d67" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.130972] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23511995-eb19-4ebe-9079-fa7fb2a98d67',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.633379] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1550bb0-c88b-4864-824e-b80ca3b52834 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.633379] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.633592] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23511995-eb19-4ebe-9079-fa7fb2a98d67 with status ACTIVE [ 959.633743] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.633844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.633901] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.634176] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.634305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.634442] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.634519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.634578] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.634729] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.634803] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.634976] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.635087] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.635148] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.635287] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.635357] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.635441] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23511995-eb19-4ebe-9079-fa7fb2a98d67 is going to be updated. [ 959.661032] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.661180] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.661180] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.661354] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.661501] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.661666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23511995-eb19-4ebe-9079-fa7fb2a98d67" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.077011] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1550bb0-c88b-4864-824e-b80ca3b52834 in Status: SUCCESS [ 960.077318] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1550bb0-c88b-4864-824e-b80ca3b52834 deletion is rescheduled due to dependency. [ 960.077469] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.077649] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.077876] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.078106] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.078253] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.078319] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.078522] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.078619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.078717] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.582135] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.670845] env[65322]: INFO networking_nsxv3.common.synchronization [None req-38d75c78-bf33-4773-b357-895abb210e9e tempest-ServerDiskConfigTestJSON-1167155511 tempest-ServerDiskConfigTestJSON-1167155511-project-member] Enqueued Resource ID: 462a2954-8d05-4805-a667-803bd399930a with Priority: HIGHEST for action security_group_rules [ 960.671748] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 462a2954-8d05-4805-a667-803bd399930a with Priority: HIGHEST for action security_group_rules [ 960.672026] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-462a2954-8d05-4805-a667-803bd399930a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.672130] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-462a2954-8d05-4805-a667-803bd399930a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.672201] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-462a2954-8d05-4805-a667-803bd399930a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.673251] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-462a2954-8d05-4805-a667-803bd399930a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.673251] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('462a2954-8d05-4805-a667-803bd399930a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.751582] env[65322]: INFO networking_nsxv3.common.synchronization [None req-a7b46a59-e195-43f5-b70b-4e5c57993fb0 tempest-ServerDiskConfigTestJSON-1167155511 tempest-ServerDiskConfigTestJSON-1167155511-project-member] Enqueued Resource ID: 462a2954-8d05-4805-a667-803bd399930a with Priority: HIGHEST for action security_group_rules [ 960.751582] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 462a2954-8d05-4805-a667-803bd399930a with Priority: HIGHEST for action security_group_rules [ 960.751582] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-462a2954-8d05-4805-a667-803bd399930a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.751582] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-462a2954-8d05-4805-a667-803bd399930a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.084705] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.198957] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.199341] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.199491] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.199841] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.199999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.200179] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 462a2954-8d05-4805-a667-803bd399930a already deleted. [ 961.200336] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-462a2954-8d05-4805-a667-803bd399930a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.200597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-462a2954-8d05-4805-a667-803bd399930a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.200854] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-462a2954-8d05-4805-a667-803bd399930a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.200950] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('462a2954-8d05-4805-a667-803bd399930a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.390358] env[65322]: INFO networking_nsxv3.common.synchronization [req-0898c97a-1e47-4e80-a596-83580fa6556b req-523c6f73-2528-42a8-9eab-693bcc70211e tempest-ServersTestJSON-586306987 tempest-ServersTestJSON-586306987-project-member] Enqueued Resource ID: f71805db-9045-455c-ad23-3895d2f4e721 with Priority: HIGHEST for action security_group_members [ 961.390862] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f71805db-9045-455c-ad23-3895d2f4e721 with Priority: HIGHEST for action security_group_members [ 961.392259] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f71805db-9045-455c-ad23-3895d2f4e721 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.392425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.392532] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.392766] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.392969] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.393130] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.393241] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.393430] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.393555] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.393685] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f71805db-9045-455c-ad23-3895d2f4e721',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.587534] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.587914] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.587914] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.587983] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.588077] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.588190] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1550bb0-c88b-4864-824e-b80ca3b52834 is going to be updated. [ 961.615660] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.615660] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.615660] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.615869] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.616108] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.625974] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1550bb0-c88b-4864-824e-b80ca3b52834 in Status: IN_PROGRESS for 2s [ 961.724415] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.724567] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.724608] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.724847] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.724959] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.725082] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 462a2954-8d05-4805-a667-803bd399930a already deleted. [ 961.725235] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-462a2954-8d05-4805-a667-803bd399930a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.896122] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.896294] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.896366] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.896589] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.896683] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.896881] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.896996] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.897101] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.897291] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.897367] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.897507] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f71805db-9045-455c-ad23-3895d2f4e721 is going to be updated. [ 961.926091] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.926091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.926285] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.926446] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.926664] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.936250] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f71805db-9045-455c-ad23-3895d2f4e721 in Status: IN_PROGRESS for 2s [ 962.632735] env[65322]: INFO networking_nsxv3.common.synchronization [req-7eced5a7-6fd5-4d1a-b46f-e313a06bccdd req-976cd9ab-5736-4472-97e8-3bc6ba5bfae6 tempest-ServersNegativeTestMultiTenantJSON-352620641 tempest-ServersNegativeTestMultiTenantJSON-352620641-project-member] Enqueued Resource ID: e2419cbe-07eb-4d04-a37e-18623c658710 with Priority: HIGHEST for action security_group_members [ 962.637237] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2419cbe-07eb-4d04-a37e-18623c658710 with Priority: HIGHEST for action security_group_members [ 962.638076] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2419cbe-07eb-4d04-a37e-18623c658710 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.638177] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.638272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.638661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.638889] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.639075] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.639184] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.639430] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.639575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.639729] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2419cbe-07eb-4d04-a37e-18623c658710',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.013953] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-260 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.014259] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-260" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.014424] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-260" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.014773] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-260" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.015166] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.015469] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.015905] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.015905] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.016128] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.016439] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 963.017277] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 963.017484] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 963.017646] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 963.017867] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 963.018066] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 963.018415] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 963.041898] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 963.042205] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 963.042360] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 963.042528] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-260" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.042836] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-2602db1d-854a-490f-95bd-23011c9556b8 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.043016] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-2602db1d-854a-490f-95bd-23011c9556b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.043134] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-2602db1d-854a-490f-95bd-23011c9556b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.043454] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-2602db1d-854a-490f-95bd-23011c9556b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.043591] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2602db1d-854a-490f-95bd-23011c9556b8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.143132] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.146950] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.147074] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.147301] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.147402] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.147748] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.147748] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.147885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.147914] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.147974] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.148069] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2419cbe-07eb-4d04-a37e-18623c658710 already deleted. [ 963.148149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.547367] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.547640] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.547765] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.548056] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.548206] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.548360] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 2602db1d-854a-490f-95bd-23011c9556b8 not found, creating... [ 963.548643] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.548824] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.548941] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.549172] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.549305] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.549573] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.549723] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.549833] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.550217] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.550412] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.550678] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 2602db1d-854a-490f-95bd-23011c9556b8 is going to be created. [ 963.579304] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.579494] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.579639] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.580012] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.580294] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.580533] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-2602db1d-854a-490f-95bd-23011c9556b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.639676] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1550bb0-c88b-4864-824e-b80ca3b52834 in Status: SUCCESS [ 963.640173] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.641033] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.641033] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.641033] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.641033] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.641033] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.641033] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.641413] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.641413] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.641413] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.946788] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f71805db-9045-455c-ad23-3895d2f4e721 in Status: SUCCESS [ 963.946788] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f71805db-9045-455c-ad23-3895d2f4e721 deletion is rescheduled due to dependency. [ 963.946788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f71805db-9045-455c-ad23-3895d2f4e721" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.959669] env[65322]: INFO networking_nsxv3.common.synchronization [req-1bc748c6-a205-4249-ad3f-af734cb77ed1 req-29c20bae-34b1-4ab0-bd70-0f2f376f3cea tempest-ServersAdminTestJSON-1989503110 tempest-ServersAdminTestJSON-1989503110-project-member] Enqueued Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_members [ 963.960209] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_members [ 963.960547] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.960647] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.960698] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.960895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.961059] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.961165] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.961228] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.961377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.961461] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.961551] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.146464] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1550bb0-c88b-4864-824e-b80ca3b52834 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.146464] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.146464] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.146718] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.146902] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.147067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.147241] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.147327] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.147499] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.147600] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.147827] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1550bb0-c88b-4864-824e-b80ca3b52834 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.148214] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.148214] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.148371] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.148568] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.150682] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.150682] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.150682] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.150682] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.150682] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.150682] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.350384] env[65322]: INFO networking_nsxv3.common.synchronization [req-7eced5a7-6fd5-4d1a-b46f-e313a06bccdd req-bf9f8864-e850-4f64-81f4-af56bed66a43 service nova] Enqueued Resource ID: e2419cbe-07eb-4d04-a37e-18623c658710 with Priority: HIGHEST for action security_group_rules [ 964.350384] env[65322]: INFO networking_nsxv3.common.synchronization [req-7eced5a7-6fd5-4d1a-b46f-e313a06bccdd req-bf9f8864-e850-4f64-81f4-af56bed66a43 service nova] Enqueued Resource ID: e2419cbe-07eb-4d04-a37e-18623c658710 with Priority: HIGHEST for action security_group_members [ 964.350384] env[65322]: INFO networking_nsxv3.common.synchronization [req-7eced5a7-6fd5-4d1a-b46f-e313a06bccdd req-bf9f8864-e850-4f64-81f4-af56bed66a43 service nova] Enqueued Resource ID: 2602db1d-854a-490f-95bd-23011c9556b8 with Priority: HIGHEST for action port [ 964.351471] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2419cbe-07eb-4d04-a37e-18623c658710 with Priority: HIGHEST for action security_group_rules [ 964.351471] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2419cbe-07eb-4d04-a37e-18623c658710 with Priority: HIGHEST for action security_group_members [ 964.351471] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2602db1d-854a-490f-95bd-23011c9556b8 with Priority: HIGHEST for action port [ 964.351650] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2419cbe-07eb-4d04-a37e-18623c658710 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.351702] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.351846] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.352171] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.352323] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2419cbe-07eb-4d04-a37e-18623c658710',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.354436] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2419cbe-07eb-4d04-a37e-18623c658710 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.356231] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.356708] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.356708] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.356708] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.357633] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.357633] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.357633] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.357633] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.357633] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2419cbe-07eb-4d04-a37e-18623c658710',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.358527] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-2602db1d-854a-490f-95bd-23011c9556b8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.358527] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2602db1d-854a-490f-95bd-23011c9556b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.358527] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2602db1d-854a-490f-95bd-23011c9556b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.359389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2602db1d-854a-490f-95bd-23011c9556b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.359389] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2602db1d-854a-490f-95bd-23011c9556b8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.464166] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.593085] env[65322]: INFO networking_nsxv3.common.synchronization [req-66e502e9-2872-407e-a142-5e73849cf34c req-2a3a38ad-53de-44b9-8788-8af9196b1972 tempest-ServerDiskConfigTestJSON-1167155511 tempest-ServerDiskConfigTestJSON-1167155511-project-member] Enqueued Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 964.593664] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 964.594150] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.594150] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.594292] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.594500] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.594887] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.594887] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.594887] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.595029] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.595425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.595425] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.654512] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d1550bb0-c88b-4864-824e-b80ca3b52834: rpc.has_security_group_logging(os_id): False [ 964.670892] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.670892] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.671141] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.671790] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.671790] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.672014] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.672259] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.672259] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.672506] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.672540] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.672740] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.672829] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.673081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.673081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.673211] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.673904] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.673904] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.673904] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.673904] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.673904] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.673904] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1550bb0-c88b-4864-824e-b80ca3b52834 is going to be updated. [ 964.739611] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.739788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.739831] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.740034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.740215] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.756981] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1550bb0-c88b-4864-824e-b80ca3b52834 in Status: IN_PROGRESS for 2s [ 964.860513] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2419cbe-07eb-4d04-a37e-18623c658710 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.860687] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.863091] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2602db1d-854a-490f-95bd-23011c9556b8 with status ACTIVE [ 964.863352] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.863505] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.863589] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.863839] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.863938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.864167] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.864691] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.864691] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.864691] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.864691] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.864897] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.864975] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.864975] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.865206] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.865237] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.865317] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2602db1d-854a-490f-95bd-23011c9556b8 is going to be updated. [ 964.866403] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e2419cbe-07eb-4d04-a37e-18623c658710',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.889219] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.889219] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.889219] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.889552] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.889552] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.889619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2602db1d-854a-490f-95bd-23011c9556b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.966159] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.100034] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.100034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.100034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.100314] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.100463] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.100684] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.100786] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.100849] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.101072] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.101204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.101307] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 is going to be updated. [ 965.133204] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.133431] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.133431] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.133606] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.133817] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.144334] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: IN_PROGRESS for 2s [ 965.369422] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e2419cbe-07eb-4d04-a37e-18623c658710',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.468070] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.468278] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.468358] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.468613] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.468713] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.468831] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 is going to be updated. [ 965.507044] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.507264] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.507264] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.507531] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.507682] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.520808] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: IN_PROGRESS for 2s [ 965.874256] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.874256] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.874256] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.874256] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.874256] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.874256] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2419cbe-07eb-4d04-a37e-18623c658710 is going to be created. [ 965.919432] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.919655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.919655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.919851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.920605] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.934298] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2419cbe-07eb-4d04-a37e-18623c658710 in Status: UNINITIALIZED for 2s [ 966.267270] env[65322]: INFO networking_nsxv3.common.synchronization [req-a28d735d-02e4-4b20-bbf6-97991dde69a2 req-e6486f33-4876-4294-8734-b67d7c055033 tempest-ImagesTestJSON-2080608290 tempest-ImagesTestJSON-2080608290-project-member] Enqueued Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 966.267650] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 966.268037] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.268213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.268213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.268372] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.268515] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.268644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.268702] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.268847] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.268942] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.269043] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.652428] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-564 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.652681] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-564" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.652843] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-564" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.654178] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-564" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.654484] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.654649] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.654762] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.655039] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.655176] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.655455] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 966.655573] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 966.655676] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 966.655777] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 966.655880] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 966.655978] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 966.656124] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 966.677528] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 966.677528] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 966.677632] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 966.677759] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-564" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.678070] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-a599da57-4ccb-499e-adaf-6d0a5e5f767a taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.678241] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-a599da57-4ccb-499e-adaf-6d0a5e5f767a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.678392] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-a599da57-4ccb-499e-adaf-6d0a5e5f767a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.678751] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-a599da57-4ccb-499e-adaf-6d0a5e5f767a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.678892] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a599da57-4ccb-499e-adaf-6d0a5e5f767a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.773452] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.774475] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.774607] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.774950] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.776623] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.777061] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.777676] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.777676] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.777676] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.777888] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.777888] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 is going to be updated. [ 966.780038] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d1550bb0-c88b-4864-824e-b80ca3b52834 in Status: SUCCESS [ 966.780038] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.813872] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.814065] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.814212] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.814542] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.814660] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.823926] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: IN_PROGRESS for 2s [ 967.155479] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: SUCCESS [ 967.155824] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 deletion is rescheduled due to dependency. [ 967.155824] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.184875] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.184875] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.184875] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.184875] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.184875] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.184875] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port a599da57-4ccb-499e-adaf-6d0a5e5f767a not found, creating... [ 967.184875] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.184875] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.184875] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.184875] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.184875] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.185454] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.185454] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.185454] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.185454] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.185454] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.185454] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: a599da57-4ccb-499e-adaf-6d0a5e5f767a is going to be created. [ 967.205614] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.205821] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.205906] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.206210] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.206482] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.206643] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-a599da57-4ccb-499e-adaf-6d0a5e5f767a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.531467] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: SUCCESS [ 967.531622] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.909908] env[65322]: INFO networking_nsxv3.common.synchronization [req-a28d735d-02e4-4b20-bbf6-97991dde69a2 req-702afbad-8249-4790-bd27-8af8cf81c547 service nova] Enqueued Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_rules [ 967.909908] env[65322]: INFO networking_nsxv3.common.synchronization [req-a28d735d-02e4-4b20-bbf6-97991dde69a2 req-702afbad-8249-4790-bd27-8af8cf81c547 service nova] Enqueued Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 967.909908] env[65322]: INFO networking_nsxv3.common.synchronization [req-a28d735d-02e4-4b20-bbf6-97991dde69a2 req-702afbad-8249-4790-bd27-8af8cf81c547 service nova] Enqueued Resource ID: a599da57-4ccb-499e-adaf-6d0a5e5f767a with Priority: HIGHEST for action port [ 967.909908] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_rules [ 967.909908] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 967.912291] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a599da57-4ccb-499e-adaf-6d0a5e5f767a with Priority: HIGHEST for action port [ 967.912291] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.913029] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.913029] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.916389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.916389] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.916389] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.916389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.916389] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-a599da57-4ccb-499e-adaf-6d0a5e5f767a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.916389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a599da57-4ccb-499e-adaf-6d0a5e5f767a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.916389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a599da57-4ccb-499e-adaf-6d0a5e5f767a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.916389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a599da57-4ccb-499e-adaf-6d0a5e5f767a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.918243] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a599da57-4ccb-499e-adaf-6d0a5e5f767a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.945511] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2419cbe-07eb-4d04-a37e-18623c658710 in Status: SUCCESS [ 967.946064] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.946570] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.946801] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.947015] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.947502] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.947621] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.947812] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.947928] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.948058] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.948185] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e2419cbe-07eb-4d04-a37e-18623c658710',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.419204] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.419543] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.425368] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a599da57-4ccb-499e-adaf-6d0a5e5f767a with status ACTIVE [ 968.425368] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.425368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.425565] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.426355] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.426355] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.426355] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.426355] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.426355] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.426355] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.426355] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.426706] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.426706] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.426706] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.426811] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.426901] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.426954] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a599da57-4ccb-499e-adaf-6d0a5e5f767a is going to be updated. [ 968.449348] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.449489] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.449558] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.449777] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.449912] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.450141] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a599da57-4ccb-499e-adaf-6d0a5e5f767a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.450449] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2419cbe-07eb-4d04-a37e-18623c658710 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.450550] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.450613] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.450834] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.451049] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.451186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.451283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.451647] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.451754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.451845] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.451995] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2419cbe-07eb-4d04-a37e-18623c658710 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.452385] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.452385] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.452525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.452720] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.452834] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.452930] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.453147] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.453265] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.453383] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.453492] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e2419cbe-07eb-4d04-a37e-18623c658710',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.807973] env[65322]: INFO networking_nsxv3.common.synchronization [req-929affc9-e90e-4686-8407-85a27b9b1b19 req-e568f69a-9609-49dd-a1d5-2232bc943ff1 tempest-DeleteServersTestJSON-1463403857 tempest-DeleteServersTestJSON-1463403857-project-member] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 968.808544] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 968.808848] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.808967] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.809372] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.809596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.809754] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.809862] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.809929] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.810094] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.810186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.810413] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.834701] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: SUCCESS [ 968.834899] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 deletion is rescheduled due to dependency. [ 968.835028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.835220] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.835386] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.835574] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.835705] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.835777] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.835929] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.836016] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.836149] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.957401] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e2419cbe-07eb-4d04-a37e-18623c658710: rpc.has_security_group_logging(os_id): False [ 968.977842] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.979348] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.979348] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.979348] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.979348] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.979348] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.979348] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.979348] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.979348] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.979348] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.979755] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.979755] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.979755] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.979850] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.979850] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.980701] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.980701] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.980701] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.980701] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.980701] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.980949] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2419cbe-07eb-4d04-a37e-18623c658710 is going to be created. [ 969.089254] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.089254] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.089254] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.089254] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.089254] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.103019] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2419cbe-07eb-4d04-a37e-18623c658710 in Status: IN_PROGRESS for 2s [ 969.313084] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.313250] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.313326] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.313548] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.313681] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.313831] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.313926] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.313983] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.314218] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.314336] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.314385] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be updated. [ 969.338815] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.355634] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.356051] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.356186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.356422] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.356571] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.367956] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: IN_PROGRESS for 2s [ 969.600102] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.600102] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.600102] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.600102] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.600102] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.600102] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.600102] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.603896] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.603896] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.603896] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 969.603896] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 969.603896] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 969.603896] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 969.603896] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 969.603896] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 969.603896] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 969.624879] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 969.625168] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 969.625370] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 969.625997] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.625997] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-f7223c0f-f8e7-4888-ae64-213d5d8fb082 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.626385] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-f7223c0f-f8e7-4888-ae64-213d5d8fb082" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.626385] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-f7223c0f-f8e7-4888-ae64-213d5d8fb082" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.626777] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-f7223c0f-f8e7-4888-ae64-213d5d8fb082" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.626963] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7223c0f-f8e7-4888-ae64-213d5d8fb082',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.843882] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.130519] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.131103] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.131103] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.131269] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.131435] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.131610] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port f7223c0f-f8e7-4888-ae64-213d5d8fb082 not found, creating... [ 970.131886] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.132096] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.132211] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.132537] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.132645] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.133942] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.133942] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.133942] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.133942] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.133942] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.133942] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: f7223c0f-f8e7-4888-ae64-213d5d8fb082 is going to be created. [ 970.154904] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.155767] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.155767] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.156059] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.156321] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.156563] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-f7223c0f-f8e7-4888-ae64-213d5d8fb082" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.347248] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.347467] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.347467] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.347700] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.347914] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.347977] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 is going to be updated. [ 970.388298] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.388499] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.388579] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.388793] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.388935] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.398324] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: IN_PROGRESS for 2s [ 970.882985] env[65322]: INFO networking_nsxv3.common.synchronization [req-929affc9-e90e-4686-8407-85a27b9b1b19 req-893cc695-14bc-4f58-b45f-468ba9db7f02 service nova] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_rules [ 970.883248] env[65322]: INFO networking_nsxv3.common.synchronization [req-929affc9-e90e-4686-8407-85a27b9b1b19 req-893cc695-14bc-4f58-b45f-468ba9db7f02 service nova] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 970.883248] env[65322]: INFO networking_nsxv3.common.synchronization [req-929affc9-e90e-4686-8407-85a27b9b1b19 req-893cc695-14bc-4f58-b45f-468ba9db7f02 service nova] Enqueued Resource ID: f7223c0f-f8e7-4888-ae64-213d5d8fb082 with Priority: HIGHEST for action port [ 970.884031] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_rules [ 970.884356] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 970.884495] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7223c0f-f8e7-4888-ae64-213d5d8fb082 with Priority: HIGHEST for action port [ 970.884775] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.884913] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.884983] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.885236] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.885324] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.886707] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.886768] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.887145] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7223c0f-f8e7-4888-ae64-213d5d8fb082 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.887294] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7223c0f-f8e7-4888-ae64-213d5d8fb082" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.887376] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7223c0f-f8e7-4888-ae64-213d5d8fb082" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.887602] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7223c0f-f8e7-4888-ae64-213d5d8fb082" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.887688] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7223c0f-f8e7-4888-ae64-213d5d8fb082',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.114945] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e2419cbe-07eb-4d04-a37e-18623c658710 in Status: SUCCESS [ 971.115275] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.379722] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: SUCCESS [ 971.379866] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 deletion is rescheduled due to dependency. [ 971.379946] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.380781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.380781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.380781] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.380781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.380781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.381160] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.381160] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.381160] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.390929] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7223c0f-f8e7-4888-ae64-213d5d8fb082 with status ACTIVE [ 971.391232] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.392171] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.392171] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.392171] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.392171] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.392171] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.392401] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.392478] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.392711] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.392855] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.393101] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.393216] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.393296] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.393451] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.393542] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.393639] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7223c0f-f8e7-4888-ae64-213d5d8fb082 is going to be updated. [ 971.395775] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.395906] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.420810] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.420935] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.421049] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.421283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.421425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.421600] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7223c0f-f8e7-4888-ae64-213d5d8fb082" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.884308] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.258394] env[65322]: INFO networking_nsxv3.common.synchronization [req-ea1ea870-6144-476b-ad4e-11c8d92c5a3f req-7f33b738-4222-4dcd-ad9a-68d517eb5b2b tempest-ImagesOneServerNegativeTestJSON-1972759635 tempest-ImagesOneServerNegativeTestJSON-1972759635-project-member] Enqueued Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGHEST for action security_group_members [ 972.258944] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGHEST for action security_group_members [ 972.259424] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d1550bb0-c88b-4864-824e-b80ca3b52834 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.259551] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.259733] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.259827] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.260432] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.260432] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.260432] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.260432] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.260432] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.260432] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.387331] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.411493] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: SUCCESS [ 972.412014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.413238] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.413957] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.414371] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.414601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.414812] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.415206] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.415357] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.415551] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.415710] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.763231] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.763456] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.763558] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.763831] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.763988] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.764251] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.764379] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.764462] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.764644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.764747] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.764887] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1550bb0-c88b-4864-824e-b80ca3b52834 is going to be updated. [ 972.790923] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.791111] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.791175] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.791344] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.791483] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.801223] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1550bb0-c88b-4864-824e-b80ca3b52834 in Status: IN_PROGRESS for 2s [ 972.890577] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.890945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.890945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.891042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.891171] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.891225] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be updated. [ 972.919420] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.919705] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.919783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.920062] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.920421] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.920506] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.920544] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.920816] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.920914] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.921016] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.921188] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.921298] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.921334] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.921494] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.921633] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.921721] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.921777] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.921933] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.922077] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.922135] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.922218] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.928518] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.928518] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.928686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.928735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.928868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.938212] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: IN_PROGRESS for 2s [ 973.474818] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16: rpc.has_security_group_logging(os_id): False [ 973.474818] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.474818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.474818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.474818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.474818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.474818] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.474818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.474818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.474818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.474818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.474818] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.474818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.474818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.474818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.478194] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.478194] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.478194] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.478194] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.478194] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.478194] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.478194] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 is going to be updated. [ 973.525451] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.525451] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.525451] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.525451] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.525451] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.554352] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: IN_PROGRESS for 2s [ 973.671320] env[65322]: INFO networking_nsxv3.common.synchronization [req-a12087d2-5c95-4c0c-a537-3c17990e6690 req-25730060-dabd-46d6-bb20-702dbf07dca1 tempest-DeleteServersAdminTestJSON-810815226 tempest-DeleteServersAdminTestJSON-810815226-project-member] Enqueued Resource ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e with Priority: HIGHEST for action security_group_members [ 973.671320] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e with Priority: HIGHEST for action security_group_members [ 973.671851] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.672287] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.672476] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.672850] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.673145] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.673393] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.673576] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.673860] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.674076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.674365] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc4077b8-3a0e-4709-8542-93ed5e2bc81e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.037580] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-620 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.037937] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.037937] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.038171] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.038429] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.038580] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.038693] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.038902] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.039050] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.039258] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 974.039370] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 974.039475] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 974.039577] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 974.039679] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 974.039777] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 974.039903] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 974.058617] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 974.058963] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 974.059232] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 974.059663] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.060109] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-86c881d0-bec9-442b-b255-b29915801297 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.060334] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-86c881d0-bec9-442b-b255-b29915801297" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.060468] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-86c881d0-bec9-442b-b255-b29915801297" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.060786] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-86c881d0-bec9-442b-b255-b29915801297" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.060927] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86c881d0-bec9-442b-b255-b29915801297',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.176452] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.176673] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.176732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.176920] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.177033] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.177250] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.177389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.177519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.177592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.177643] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.177729] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e already deleted. [ 974.177817] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.358344] env[65322]: INFO networking_nsxv3.common.synchronization [req-ea72e2c7-278d-4eca-98f8-1f628212301e req-0a77f8c7-7337-4ea4-b06c-53261ea0bfd7 tempest-ServersNegativeTestMultiTenantJSON-352620641 tempest-ServersNegativeTestMultiTenantJSON-352620641-project-member] Enqueued Resource ID: e2419cbe-07eb-4d04-a37e-18623c658710 with Priority: HIGHEST for action security_group_members [ 974.358936] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2419cbe-07eb-4d04-a37e-18623c658710 with Priority: HIGHEST for action security_group_members [ 974.359274] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e2419cbe-07eb-4d04-a37e-18623c658710 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.359465] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.359561] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.359779] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.359940] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.360085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.360149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.360324] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.360513] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.360513] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e2419cbe-07eb-4d04-a37e-18623c658710',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.563769] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.564120] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.564271] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.564618] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.564814] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.565011] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 86c881d0-bec9-442b-b255-b29915801297 not found, creating... [ 974.565332] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.565537] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.565697] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.565982] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.566161] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.566517] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.566724] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.566948] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.567169] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.567370] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.567559] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 86c881d0-bec9-442b-b255-b29915801297 is going to be created. [ 974.590197] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.590524] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.590715] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.591096] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.591523] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.591751] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-86c881d0-bec9-442b-b255-b29915801297" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.744602] env[65322]: INFO networking_nsxv3.common.synchronization [req-3071b2e7-c395-4ad2-b86b-961d801eb8f9 req-3aed9582-c834-4d89-8cbe-542d8f1e3b29 tempest-AttachInterfacesTestJSON-353803948 tempest-AttachInterfacesTestJSON-353803948-project-member] Enqueued Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 974.745510] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 974.745755] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.745755] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.745864] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.746101] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.746295] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.746406] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.746467] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.746635] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.746718] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.746808] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.811978] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d1550bb0-c88b-4864-824e-b80ca3b52834 in Status: SUCCESS [ 974.812265] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d1550bb0-c88b-4864-824e-b80ca3b52834 deletion is rescheduled due to dependency. [ 974.812395] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.863823] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.863979] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.864312] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.864445] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.864557] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.864810] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.864917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.864977] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.865154] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.865254] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.865344] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2419cbe-07eb-4d04-a37e-18623c658710 is going to be updated. [ 974.894110] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.894110] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.894110] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.894110] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.894110] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.904331] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2419cbe-07eb-4d04-a37e-18623c658710 in Status: IN_PROGRESS for 2s [ 974.947996] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: SUCCESS [ 974.948377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.948551] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.948759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.948950] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.949168] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.949230] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.949399] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.949501] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.949604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.949740] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.049399] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-896 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.049750] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.049750] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.049962] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.050226] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.050380] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.050493] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.050697] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.050841] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.051059] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 975.051169] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 975.051273] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 975.051376] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 975.051480] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 975.051581] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 975.051708] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 975.071933] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 975.072151] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 975.072264] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 975.072445] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.072759] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-22c0ac41-ffe6-4b70-99c3-d698a1a3267b taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.072943] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-22c0ac41-ffe6-4b70-99c3-d698a1a3267b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.073083] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-22c0ac41-ffe6-4b70-99c3-d698a1a3267b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.073427] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-22c0ac41-ffe6-4b70-99c3-d698a1a3267b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.073573] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22c0ac41-ffe6-4b70-99c3-d698a1a3267b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.249238] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.249408] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.249480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.249713] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.249804] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.250268] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.250268] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.250268] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.250436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.250436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.250514] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 already deleted. [ 975.250514] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.336112] env[65322]: INFO networking_nsxv3.common.synchronization [req-a12087d2-5c95-4c0c-a537-3c17990e6690 req-c6dbc8d0-8f6c-43ac-98c2-15ced98c1b3a service nova] Enqueued Resource ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e with Priority: HIGHEST for action security_group_rules [ 975.336206] env[65322]: INFO networking_nsxv3.common.synchronization [req-a12087d2-5c95-4c0c-a537-3c17990e6690 req-c6dbc8d0-8f6c-43ac-98c2-15ced98c1b3a service nova] Enqueued Resource ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e with Priority: HIGHEST for action security_group_members [ 975.336833] env[65322]: INFO networking_nsxv3.common.synchronization [req-a12087d2-5c95-4c0c-a537-3c17990e6690 req-c6dbc8d0-8f6c-43ac-98c2-15ced98c1b3a service nova] Enqueued Resource ID: 86c881d0-bec9-442b-b255-b29915801297 with Priority: HIGHEST for action port [ 975.336914] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e with Priority: HIGHEST for action security_group_rules [ 975.337124] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e with Priority: HIGHEST for action security_group_members [ 975.337261] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86c881d0-bec9-442b-b255-b29915801297 with Priority: HIGHEST for action port [ 975.337553] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc4077b8-3a0e-4709-8542-93ed5e2bc81e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.337659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.337754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.338356] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.338356] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc4077b8-3a0e-4709-8542-93ed5e2bc81e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.339543] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.339665] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.340409] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.340409] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.340527] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.340695] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.340695] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.340960] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.341126] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.341126] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc4077b8-3a0e-4709-8542-93ed5e2bc81e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.342044] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-86c881d0-bec9-442b-b255-b29915801297 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.342229] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86c881d0-bec9-442b-b255-b29915801297" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.342313] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86c881d0-bec9-442b-b255-b29915801297" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.342457] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86c881d0-bec9-442b-b255-b29915801297" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.342542] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86c881d0-bec9-442b-b255-b29915801297',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.451524] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.451939] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.451939] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.452137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.452307] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.452307] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.452435] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.452519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.452602] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.452735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.452849] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.452947] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.453047] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.453209] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.453350] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.453439] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.453492] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.453626] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.453692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.453793] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.453878] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.571337] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: SUCCESS [ 975.572690] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.576709] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.576709] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.576983] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.577199] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.578440] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.578440] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 22c0ac41-ffe6-4b70-99c3-d698a1a3267b not found, creating... [ 975.578440] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.578440] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.578440] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.578440] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.578440] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.578747] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.579399] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.579399] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.579399] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.579399] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.579639] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 22c0ac41-ffe6-4b70-99c3-d698a1a3267b is going to be created. [ 975.599596] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.599820] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.599927] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.600254] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.600537] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.600776] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-22c0ac41-ffe6-4b70-99c3-d698a1a3267b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.844626] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.844626] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.846918] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc4077b8-3a0e-4709-8542-93ed5e2bc81e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.846918] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86c881d0-bec9-442b-b255-b29915801297 with status ACTIVE [ 975.846918] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.846918] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.846918] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.846918] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.846918] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.847367] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.847367] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.847367] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.847466] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.847540] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.847782] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.848536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.848536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.848536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.848536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.848536] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86c881d0-bec9-442b-b255-b29915801297 is going to be updated. [ 975.873884] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.874048] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.874048] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.874303] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.874910] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.874910] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86c881d0-bec9-442b-b255-b29915801297" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.956560] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e863a544-814a-4bca-b4b1-35f9a61afcd3: rpc.has_security_group_logging(os_id): False [ 975.984229] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.984229] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.984229] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.984229] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.984229] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.984229] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.984229] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.984229] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.984229] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.984229] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.984229] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.985218] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.985290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.985456] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.985619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.985774] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.986047] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.986047] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.986149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.986193] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.986270] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be updated. [ 976.072342] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.072639] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.072639] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.072762] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.073064] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.090410] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: IN_PROGRESS for 2s [ 976.351191] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc4077b8-3a0e-4709-8542-93ed5e2bc81e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.364593] env[65322]: INFO networking_nsxv3.common.synchronization [req-3071b2e7-c395-4ad2-b86b-961d801eb8f9 req-0283c8a6-8595-4088-a94f-b4e44e1f1374 service nova] Enqueued Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_rules [ 976.364593] env[65322]: INFO networking_nsxv3.common.synchronization [req-3071b2e7-c395-4ad2-b86b-961d801eb8f9 req-0283c8a6-8595-4088-a94f-b4e44e1f1374 service nova] Enqueued Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 976.364593] env[65322]: INFO networking_nsxv3.common.synchronization [req-3071b2e7-c395-4ad2-b86b-961d801eb8f9 req-0283c8a6-8595-4088-a94f-b4e44e1f1374 service nova] Enqueued Resource ID: 22c0ac41-ffe6-4b70-99c3-d698a1a3267b with Priority: HIGHEST for action port [ 976.365930] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_rules [ 976.365930] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 976.365930] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22c0ac41-ffe6-4b70-99c3-d698a1a3267b with Priority: HIGHEST for action port [ 976.365930] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.366151] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.366151] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.366391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.366438] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.368275] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.368275] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.368275] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.368275] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.368275] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.368275] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.368275] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.368275] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.368275] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.368275] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.369279] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-22c0ac41-ffe6-4b70-99c3-d698a1a3267b taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.369387] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22c0ac41-ffe6-4b70-99c3-d698a1a3267b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.369447] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22c0ac41-ffe6-4b70-99c3-d698a1a3267b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.370167] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22c0ac41-ffe6-4b70-99c3-d698a1a3267b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.370167] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22c0ac41-ffe6-4b70-99c3-d698a1a3267b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.854225] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.854604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.854604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.854763] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.854859] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.854967] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e is going to be created. [ 976.872492] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.872492] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.872492] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.873204] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22c0ac41-ffe6-4b70-99c3-d698a1a3267b with status ACTIVE [ 976.873449] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.873628] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.873751] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.874082] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.874082] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.874336] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.874469] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.874469] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.874679] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.874774] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.875042] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.875277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.875351] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.875524] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.876245] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.876245] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22c0ac41-ffe6-4b70-99c3-d698a1a3267b is going to be updated. [ 976.879452] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.879613] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.879717] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.879950] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.880154] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.893626] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e in Status: UNINITIALIZED for 2s [ 976.901769] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.901921] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.901995] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.902328] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.902467] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.902627] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22c0ac41-ffe6-4b70-99c3-d698a1a3267b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.915335] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e2419cbe-07eb-4d04-a37e-18623c658710 in Status: SUCCESS [ 976.915335] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e2419cbe-07eb-4d04-a37e-18623c658710 deletion is rescheduled due to dependency. [ 976.915502] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.378936] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.883497] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.883497] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.883497] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.883497] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.883497] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.883497] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 is going to be created. [ 977.909476] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.909604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.909700] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.909930] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.910114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.920610] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: UNINITIALIZED for 2s [ 978.055357] env[65322]: INFO networking_nsxv3.common.synchronization [req-76e42a45-526b-4bf0-ae7a-e6cb7a420c04 req-31d27972-c86b-4d50-ab1d-83b0059bdb18 tempest-MultipleCreateTestJSON-731324011 tempest-MultipleCreateTestJSON-731324011-project-member] Enqueued Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_members [ 978.055922] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_members [ 978.056286] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.056427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.056503] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.056749] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.056908] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.057028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.057090] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.057242] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.057327] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.057422] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.105362] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: SUCCESS [ 978.105528] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.426240] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-755 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.426240] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-755" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.428076] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-755" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.428570] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-755" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.429090] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.433328] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.433328] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.433328] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.433328] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.433328] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 978.433328] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 978.433328] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 978.433328] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 978.433328] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 978.433328] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 978.433611] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 978.453019] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 978.454295] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 978.454492] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 978.455571] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-755" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.455997] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-4eb5977e-201d-4013-b849-7ba705d77303 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.456163] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-4eb5977e-201d-4013-b849-7ba705d77303" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.456269] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-4eb5977e-201d-4013-b849-7ba705d77303" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.456642] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-4eb5977e-201d-4013-b849-7ba705d77303" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.456777] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4eb5977e-201d-4013-b849-7ba705d77303',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.564789] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.564789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.564789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.564789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.564789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.564789] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.564789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.564789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.564789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.564789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.564789] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a is going to be updated. [ 978.590686] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.590833] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.590911] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.591139] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.591279] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.601490] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: IN_PROGRESS for 2s [ 978.904380] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e in Status: SUCCESS [ 978.904380] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.904670] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.904745] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.905251] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.905251] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.905251] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.905496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.905496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.905496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.905646] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc4077b8-3a0e-4709-8542-93ed5e2bc81e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.959853] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.960110] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.960235] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.960599] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.960763] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.960921] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 4eb5977e-201d-4013-b849-7ba705d77303 not found, creating... [ 978.961202] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.961361] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.961475] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.961705] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.961835] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.962146] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.962317] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.962477] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.962843] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.963016] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.963265] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 4eb5977e-201d-4013-b849-7ba705d77303 is going to be created. [ 978.986073] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.986303] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.986455] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.987027] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.987294] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.987570] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-4eb5977e-201d-4013-b849-7ba705d77303" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.395851] env[65322]: INFO networking_nsxv3.common.synchronization [req-99d4f94a-0333-45b2-8a04-534155b23733 req-e2001f1c-58dd-4b02-aa2a-44c5b7b3ea87 tempest-ServersAdminNegativeTestJSON-636642581 tempest-ServersAdminNegativeTestJSON-636642581-project-member] Enqueued Resource ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 with Priority: HIGHEST for action security_group_members [ 979.396489] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 with Priority: HIGHEST for action security_group_members [ 979.397477] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-dae95ed3-e249-4093-bc1a-6e3471cc5953 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.397477] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.397477] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.397477] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.397477] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.397941] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.397941] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.397941] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.397941] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.397941] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dae95ed3-e249-4093-bc1a-6e3471cc5953',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.407822] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.407822] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.407822] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.408271] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.408271] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.408271] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.408271] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.408474] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.408530] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.408581] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.408746] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.408850] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.408918] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.409079] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.409595] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.409595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.409595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.409595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.409595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.409834] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.409834] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc4077b8-3a0e-4709-8542-93ed5e2bc81e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.760298] env[65322]: INFO networking_nsxv3.common.synchronization [req-76e42a45-526b-4bf0-ae7a-e6cb7a420c04 req-99d7e804-2996-4937-a230-a78ddf2fd20a service nova] Enqueued Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_rules [ 979.760559] env[65322]: INFO networking_nsxv3.common.synchronization [req-76e42a45-526b-4bf0-ae7a-e6cb7a420c04 req-99d7e804-2996-4937-a230-a78ddf2fd20a service nova] Enqueued Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_members [ 979.760612] env[65322]: INFO networking_nsxv3.common.synchronization [req-76e42a45-526b-4bf0-ae7a-e6cb7a420c04 req-99d7e804-2996-4937-a230-a78ddf2fd20a service nova] Enqueued Resource ID: 4eb5977e-201d-4013-b849-7ba705d77303 with Priority: HIGHEST for action port [ 979.761218] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_rules [ 979.761360] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_members [ 979.761445] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb5977e-201d-4013-b849-7ba705d77303 with Priority: HIGHEST for action port [ 979.761726] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.761845] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.761911] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.762174] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.762252] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.764910] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.764910] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.764910] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-4eb5977e-201d-4013-b849-7ba705d77303 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.764910] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4eb5977e-201d-4013-b849-7ba705d77303" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.764910] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4eb5977e-201d-4013-b849-7ba705d77303" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.764910] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4eb5977e-201d-4013-b849-7ba705d77303" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.764910] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4eb5977e-201d-4013-b849-7ba705d77303',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.901034] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.901034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.901034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.901034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.901269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.901269] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.901352] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.901417] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.901569] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.901635] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.901722] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 is going to be updated. [ 979.912594] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc4077b8-3a0e-4709-8542-93ed5e2bc81e: rpc.has_security_group_logging(os_id): False [ 979.932626] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.932626] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.932806] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.933316] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.933569] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.933908] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.934119] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.934455] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.934611] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.934732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.934965] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.935178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.936153] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.936230] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.936338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.936618] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.936755] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.936755] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.937392] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.937392] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.937392] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e is going to be created. [ 979.939433] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.939536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.939597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.939748] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.941017] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.941726] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: SUCCESS [ 979.941899] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.942455] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.942613] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.942775] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.942871] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.942932] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.943082] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.943152] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.943231] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.943317] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.953412] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 in Status: IN_PROGRESS for 2s [ 980.007054] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.007054] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.007273] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.007321] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.007505] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.020537] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e in Status: IN_PROGRESS for 2s [ 980.269945] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.269945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.269945] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4eb5977e-201d-4013-b849-7ba705d77303 with status ACTIVE [ 980.269945] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.269945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.269945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.269945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.270308] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.270308] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.270308] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.270419] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.270507] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.270593] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.270732] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.271079] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.271079] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.271079] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.271079] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.271233] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4eb5977e-201d-4013-b849-7ba705d77303 is going to be updated. [ 980.305815] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.305986] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.306059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.306269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.306402] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.306851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4eb5977e-201d-4013-b849-7ba705d77303" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.445734] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.445734] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.445983] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.445983] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.446498] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.446498] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.446498] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.446498] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.446688] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.446688] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.446993] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.446993] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.446993] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.447216] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.447333] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.447413] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.447413] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.447554] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.447624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.447704] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.447855] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.600593] env[65322]: INFO networking_nsxv3.common.synchronization [req-76e42a45-526b-4bf0-ae7a-e6cb7a420c04 req-13babe18-67d5-4524-a693-e1878937ea47 tempest-MultipleCreateTestJSON-731324011 tempest-MultipleCreateTestJSON-731324011-project-member] Enqueued Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_members [ 980.601013] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_members [ 980.601323] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.601418] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.613482] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: SUCCESS [ 980.613667] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a deletion is rescheduled due to dependency. [ 980.613829] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.614018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.614365] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.614548] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.614664] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.614729] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.614881] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.614961] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.615075] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.905962] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-755 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.905962] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-755" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.906325] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-755" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.906359] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-755" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.907249] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.907372] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.907647] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.908345] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.908345] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.908345] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 980.908500] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 980.908612] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 980.908832] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 980.909067] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 980.909245] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 980.912401] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 980.931385] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 980.931549] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 980.932054] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 980.932054] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-755" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.932380] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-0b9c8739-9de7-46a8-b548-81702a4d0495 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.932580] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-0b9c8739-9de7-46a8-b548-81702a4d0495" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.932773] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-0b9c8739-9de7-46a8-b548-81702a4d0495" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.933289] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-0b9c8739-9de7-46a8-b548-81702a4d0495" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.933480] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b9c8739-9de7-46a8-b548-81702a4d0495',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.950468] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06de8ea8-08fd-4206-a96b-fafa1c856867: rpc.has_security_group_logging(os_id): False [ 980.969453] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.969453] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.969453] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.969762] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.969762] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.969863] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.969964] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.970098] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.970340] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.970446] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.970660] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.970785] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.970995] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.971080] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.971180] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.971402] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.971527] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.971607] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.971771] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.971871] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.971974] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 is going to be created. [ 981.041444] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.041607] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.041661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.042702] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.042702] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.063248] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: IN_PROGRESS for 2s [ 981.116946] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.437184] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.437274] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.437338] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.437624] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.437771] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.437925] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 0b9c8739-9de7-46a8-b548-81702a4d0495 not found, creating... [ 981.438300] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.438412] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.438736] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.438841] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.438950] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.439288] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.439445] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.439560] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.439803] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.439935] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.440117] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 0b9c8739-9de7-46a8-b548-81702a4d0495 is going to be created. [ 981.470351] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.471263] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.471263] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.471263] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.471463] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.471603] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-0b9c8739-9de7-46a8-b548-81702a4d0495" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.619486] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.972426] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 in Status: SUCCESS [ 981.972763] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 deletion is rescheduled due to dependency. [ 981.972932] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.041311] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e in Status: SUCCESS [ 982.041597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.125157] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.125157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.125157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.125506] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.125506] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.125506] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a is going to be updated. [ 982.172148] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.172148] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.172148] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.172469] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.172633] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.184409] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: IN_PROGRESS for 2s [ 982.260183] env[65322]: INFO networking_nsxv3.common.synchronization [req-76e42a45-526b-4bf0-ae7a-e6cb7a420c04 req-34b84b55-f08d-41f8-b632-3c6df1337b8d service nova] Enqueued Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_rules [ 982.260384] env[65322]: INFO networking_nsxv3.common.synchronization [req-76e42a45-526b-4bf0-ae7a-e6cb7a420c04 req-34b84b55-f08d-41f8-b632-3c6df1337b8d service nova] Enqueued Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_members [ 982.260522] env[65322]: INFO networking_nsxv3.common.synchronization [req-76e42a45-526b-4bf0-ae7a-e6cb7a420c04 req-34b84b55-f08d-41f8-b632-3c6df1337b8d service nova] Enqueued Resource ID: 0b9c8739-9de7-46a8-b548-81702a4d0495 with Priority: HIGHEST for action port [ 982.261083] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_rules [ 982.261220] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_members [ 982.261316] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b9c8739-9de7-46a8-b548-81702a4d0495 with Priority: HIGHEST for action port [ 982.261970] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.262129] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.262412] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.262542] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.262773] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b9c8739-9de7-46a8-b548-81702a4d0495 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.262907] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b9c8739-9de7-46a8-b548-81702a4d0495" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.262962] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b9c8739-9de7-46a8-b548-81702a4d0495" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.263203] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b9c8739-9de7-46a8-b548-81702a4d0495" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.263307] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b9c8739-9de7-46a8-b548-81702a4d0495',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.769295] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b9c8739-9de7-46a8-b548-81702a4d0495 with status ACTIVE [ 982.769295] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.769295] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.769295] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.774573] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.774573] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.774573] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.774573] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.774573] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.774573] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.774573] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.774573] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.774573] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.774573] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.777490] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.777490] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.777490] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b9c8739-9de7-46a8-b548-81702a4d0495 is going to be updated. [ 982.812838] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.814544] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.815124] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.815124] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.815557] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.816115] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b9c8739-9de7-46a8-b548-81702a4d0495" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.079334] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: SUCCESS [ 983.079747] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.197441] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: SUCCESS [ 984.197862] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.197862] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.198080] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.198276] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.198393] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.198459] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.199492] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.199492] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.199492] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.199492] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.201249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.201480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.201604] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.201711] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.201935] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.203159] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.203397] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.203552] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.701977] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.702227] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.706057] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.812238] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.812644] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-547" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.812975] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-547" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.813363] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-547" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.813649] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.814204] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.814204] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.814204] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.814396] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.814610] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 984.814741] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 984.814850] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 984.814967] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 984.815109] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 984.815222] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 984.815355] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 984.836483] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 984.836674] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 984.836757] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 984.836877] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-547" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.837235] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-040e16d0-2c73-4b9c-8aec-0d70c6f20e1f taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.838178] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-040e16d0-2c73-4b9c-8aec-0d70c6f20e1f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.838178] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-040e16d0-2c73-4b9c-8aec-0d70c6f20e1f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.838178] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-040e16d0-2c73-4b9c-8aec-0d70c6f20e1f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.838178] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('040e16d0-2c73-4b9c-8aec-0d70c6f20e1f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.208890] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.343221] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.343526] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.344036] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.344524] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.344740] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.345105] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.345425] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.345577] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.345919] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.346090] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.346442] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.346615] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.346725] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.346936] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.347097] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.347251] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 040e16d0-2c73-4b9c-8aec-0d70c6f20e1f is going to be updated. [ 985.372110] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.372340] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.372415] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.372692] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.372897] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.373254] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-040e16d0-2c73-4b9c-8aec-0d70c6f20e1f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.713633] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.713835] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.713835] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.714052] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.714149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.714245] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a is going to be updated. [ 985.751810] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.751948] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.752036] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.752257] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.752401] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.763789] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: IN_PROGRESS for 2s [ 986.108168] env[65322]: INFO networking_nsxv3.common.synchronization [req-a8459b84-6569-48f5-adec-de34712cc807 req-228e9272-2da8-4eb0-8cca-37fcefdaa82f service nova] Enqueued Resource ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 with Priority: HIGHEST for action security_group_rules [ 986.108569] env[65322]: INFO networking_nsxv3.common.synchronization [req-a8459b84-6569-48f5-adec-de34712cc807 req-228e9272-2da8-4eb0-8cca-37fcefdaa82f service nova] Enqueued Resource ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 with Priority: HIGHEST for action security_group_members [ 986.110188] env[65322]: INFO networking_nsxv3.common.synchronization [req-a8459b84-6569-48f5-adec-de34712cc807 req-228e9272-2da8-4eb0-8cca-37fcefdaa82f service nova] Enqueued Resource ID: 040e16d0-2c73-4b9c-8aec-0d70c6f20e1f with Priority: HIGHEST for action port [ 986.110188] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 with Priority: HIGHEST for action security_group_rules [ 986.110188] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 with Priority: HIGHEST for action security_group_members [ 986.110188] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 040e16d0-2c73-4b9c-8aec-0d70c6f20e1f with Priority: HIGHEST for action port [ 986.110767] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbf21d11-c10d-47fc-811b-f6af5267a9d6 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.111151] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.111449] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.111920] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.112158] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbf21d11-c10d-47fc-811b-f6af5267a9d6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.114552] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbf21d11-c10d-47fc-811b-f6af5267a9d6 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.115121] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.116032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.116032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.116505] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.116638] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.117187] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.117332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.117483] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.117597] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbf21d11-c10d-47fc-811b-f6af5267a9d6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.119517] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-040e16d0-2c73-4b9c-8aec-0d70c6f20e1f taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.119676] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-040e16d0-2c73-4b9c-8aec-0d70c6f20e1f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.119742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-040e16d0-2c73-4b9c-8aec-0d70c6f20e1f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.119932] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-040e16d0-2c73-4b9c-8aec-0d70c6f20e1f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.120237] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('040e16d0-2c73-4b9c-8aec-0d70c6f20e1f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.622146] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbf21d11-c10d-47fc-811b-f6af5267a9d6 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.622584] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.622731] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fbf21d11-c10d-47fc-811b-f6af5267a9d6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.623732] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 040e16d0-2c73-4b9c-8aec-0d70c6f20e1f with status ACTIVE [ 986.623986] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.624069] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.624214] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.624481] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.624568] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.625362] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.625362] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.625362] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.625362] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.625362] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.625628] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.625628] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.625708] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.625868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.625923] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.626017] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 040e16d0-2c73-4b9c-8aec-0d70c6f20e1f is going to be updated. [ 986.672294] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.672294] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.672294] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.672509] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.672676] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.672883] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-040e16d0-2c73-4b9c-8aec-0d70c6f20e1f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.128613] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fbf21d11-c10d-47fc-811b-f6af5267a9d6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.632179] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.632545] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.632545] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.632877] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.633016] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.633179] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 is going to be updated. [ 987.664471] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.664759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.664872] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.665062] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.665198] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.675566] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 in Status: IN_PROGRESS for 2s [ 987.776371] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: SUCCESS [ 987.776803] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.777071] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.777382] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.777647] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.777825] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.777949] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.778177] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.778268] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.778374] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.994622] env[65322]: INFO networking_nsxv3.common.synchronization [req-b4cf878c-b4e9-46a9-bdff-78d29b04ab6b req-6584cf50-0730-4204-9d74-a240a397f95c tempest-DeleteServersAdminTestJSON-613196575 tempest-DeleteServersAdminTestJSON-613196575-project-admin] Enqueued Resource ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e with Priority: HIGHEST for action security_group_members [ 987.995314] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e with Priority: HIGHEST for action security_group_members [ 987.995676] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.995788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.995868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.996128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.996327] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.996487] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.996557] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.996767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.996855] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.997060] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc4077b8-3a0e-4709-8542-93ed5e2bc81e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.282164] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.500025] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.500173] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.500173] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.500399] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.500496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.500709] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.500822] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.500886] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.501066] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.501154] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.501253] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e is going to be updated. [ 988.533041] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.533302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.533691] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.533691] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.533878] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.544781] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e in Status: IN_PROGRESS for 2s [ 988.783794] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.287423] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.287423] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.287423] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.287681] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.287681] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.287864] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a is going to be updated. [ 989.343129] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.343418] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.343488] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.343829] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.344066] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.356071] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: IN_PROGRESS for 2s [ 989.408957] env[65322]: INFO networking_nsxv3.common.synchronization [req-6a8dee23-fa55-4c7e-9096-16ecbb331545 req-70f10592-03fb-4e00-95a7-eb4e00183f0d tempest-ImagesTestJSON-2080608290 tempest-ImagesTestJSON-2080608290-project-member] Enqueued Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 989.409700] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 with Priority: HIGHEST for action security_group_members [ 989.409969] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.410430] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.410430] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.410430] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.410565] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.410707] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.410784] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.411018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.411166] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.411311] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.687637] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 in Status: SUCCESS [ 989.687881] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.688100] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.688383] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.688599] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.688770] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.688879] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.689128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.689258] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.689387] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.689534] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fbf21d11-c10d-47fc-811b-f6af5267a9d6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.914824] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.915224] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.915224] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.915293] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.915867] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.915867] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.915867] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.916066] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.916098] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.916188] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.916279] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 is going to be updated. [ 989.952559] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.952816] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.953052] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.953275] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.953456] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.966307] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: IN_PROGRESS for 2s [ 990.124512] env[65322]: INFO networking_nsxv3.common.synchronization [req-1edb88c5-a8dd-4ba0-8644-2cb35c245f5c req-f58db0ec-f803-4307-9b41-ffaf4189c653 tempest-AttachInterfacesTestJSON-353803948 tempest-AttachInterfacesTestJSON-353803948-project-member] Enqueued Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 990.125091] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 990.125405] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.125522] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.125588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.125830] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.126945] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.127393] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.128263] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.128524] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.128754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.129526] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.197288] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fbf21d11-c10d-47fc-811b-f6af5267a9d6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.556992] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e in Status: SUCCESS [ 990.557206] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e deletion is rescheduled due to dependency. [ 990.557338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.638669] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.638669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.638669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.638669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.638905] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.638963] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.639085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.639142] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.639311] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.639390] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.639479] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 is going to be updated. [ 990.670259] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.670904] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.670904] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.670904] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.671080] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.682354] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: IN_PROGRESS for 2s [ 990.697554] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fbf21d11-c10d-47fc-811b-f6af5267a9d6: rpc.has_security_group_logging(os_id): False [ 990.718863] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.719091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.719205] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.720114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.720114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.720114] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.720278] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.720278] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.720549] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.720668] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.720784] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 is going to be updated. [ 990.824047] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.824047] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.824047] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.824364] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.824541] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.873250] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 in Status: IN_PROGRESS for 2s [ 991.373525] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: SUCCESS [ 991.373525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.373525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.373525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.373525] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.373525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.373525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.373525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.373525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.373525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.373525] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.373525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.373525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.373525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.373525] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.373525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.373525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.373525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.373525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.374781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.374781] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.525606] env[65322]: INFO networking_nsxv3.common.synchronization [req-044c1098-0fe7-4668-a82b-47d4a70849c3 req-d442029c-5a14-45e7-bbdc-50c1ac028b21 tempest-ServerDiskConfigTestJSON-1167155511 tempest-ServerDiskConfigTestJSON-1167155511-project-member] Enqueued Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 991.526033] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 991.527165] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.527316] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.527377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.527575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.527731] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.527825] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.527903] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.528138] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.528138] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.528277] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.876696] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef78971b-78bd-41bb-9a08-bdae7a3b226a: rpc.has_security_group_logging(os_id): False [ 991.898289] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.898400] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.898446] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.899538] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.899538] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.899538] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.899538] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.899538] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.899538] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.899963] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.899963] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.900113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.900433] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.900939] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.900939] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.900939] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.901175] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.901175] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.901320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.902051] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.902051] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a is going to be updated. [ 991.956024] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-173 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.956024] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-173" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.956024] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-173" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.956024] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-173" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.956828] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.957265] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.957506] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.957845] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.958120] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.958436] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 991.958662] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 991.960038] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 991.960038] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 991.960038] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 991.960038] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 991.960038] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 991.975459] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.978032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.978032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.978032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.978032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.978424] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 in Status: SUCCESS [ 991.978884] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16 deletion is rescheduled due to dependency. [ 991.979126] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.984149] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 991.984821] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 991.985203] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 991.985687] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-173" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.986224] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-d060214b-af37-47ec-8f08-928bb338dbe3 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.986754] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-d060214b-af37-47ec-8f08-928bb338dbe3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.987014] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-d060214b-af37-47ec-8f08-928bb338dbe3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.988030] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-d060214b-af37-47ec-8f08-928bb338dbe3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.988030] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d060214b-af37-47ec-8f08-928bb338dbe3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.994610] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: IN_PROGRESS for 2s [ 992.033024] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.033024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.033024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.033024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.033024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.033024] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.033024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.033024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.033024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.033024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.033024] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 is going to be updated. [ 992.063362] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.064012] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.064152] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.064382] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.064595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.077927] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: IN_PROGRESS for 2s [ 992.493989] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.494410] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.494519] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.494860] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.495021] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.495761] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port d060214b-af37-47ec-8f08-928bb338dbe3 not found, creating... [ 992.495761] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.495761] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.495761] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.496027] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.496210] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.496861] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.501240] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.501535] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.501916] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.502014] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.502229] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: d060214b-af37-47ec-8f08-928bb338dbe3 is going to be created. [ 992.526343] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.526779] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.526946] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.527624] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.528076] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.528186] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-d060214b-af37-47ec-8f08-928bb338dbe3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.704492] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: SUCCESS [ 992.704492] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 deletion is rescheduled due to dependency. [ 992.704492] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.892339] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 in Status: SUCCESS [ 992.892670] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.311936] env[65322]: INFO networking_nsxv3.common.synchronization [req-044c1098-0fe7-4668-a82b-47d4a70849c3 req-bd58bee9-8471-4e94-995c-864f8f79a01e service nova] Enqueued Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_rules [ 993.312321] env[65322]: INFO networking_nsxv3.common.synchronization [req-044c1098-0fe7-4668-a82b-47d4a70849c3 req-bd58bee9-8471-4e94-995c-864f8f79a01e service nova] Enqueued Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 993.312509] env[65322]: INFO networking_nsxv3.common.synchronization [req-044c1098-0fe7-4668-a82b-47d4a70849c3 req-bd58bee9-8471-4e94-995c-864f8f79a01e service nova] Enqueued Resource ID: d060214b-af37-47ec-8f08-928bb338dbe3 with Priority: HIGHEST for action port [ 993.313199] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_rules [ 993.313361] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 993.313464] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d060214b-af37-47ec-8f08-928bb338dbe3 with Priority: HIGHEST for action port [ 993.313810] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.314062] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.314288] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.314677] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.314677] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.315813] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.315914] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.316306] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-d060214b-af37-47ec-8f08-928bb338dbe3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.316493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d060214b-af37-47ec-8f08-928bb338dbe3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.316571] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d060214b-af37-47ec-8f08-928bb338dbe3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.317320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d060214b-af37-47ec-8f08-928bb338dbe3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.317320] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d060214b-af37-47ec-8f08-928bb338dbe3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.739176] env[65322]: INFO networking_nsxv3.common.synchronization [req-d1b4658d-c6d8-4fb2-8d4b-8034bf45af83 req-67d24fe2-231b-4ec9-ac30-623efe83acb3 tempest-AttachInterfacesTestJSON-353803948 tempest-AttachInterfacesTestJSON-353803948-project-member] Enqueued Resource ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 with Priority: HIGHEST for action security_group_members [ 993.740321] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 with Priority: HIGHEST for action security_group_members [ 993.740848] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.740977] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.741075] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.743625] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.743783] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.743879] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.743997] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.744303] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.744432] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.744593] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9697a5d8-1fb8-45ef-a30e-a1b99942e3e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.995422] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d060214b-af37-47ec-8f08-928bb338dbe3 with status ACTIVE [ 993.995650] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.995795] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.995946] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.996987] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.996987] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.996987] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.996987] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.996987] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.997276] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.997276] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.997535] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.001027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.001027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.001027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.001027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.001027] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d060214b-af37-47ec-8f08-928bb338dbe3 is going to be updated. [ 994.001027] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.001027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.024280] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: SUCCESS [ 994.025609] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.025609] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.025609] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.025609] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.035064] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.035064] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.035064] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.035064] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.035546] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.035546] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d060214b-af37-47ec-8f08-928bb338dbe3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.098556] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: SUCCESS [ 994.098556] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 deletion is rescheduled due to dependency. [ 994.098556] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.098842] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.098933] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.099152] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.099301] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.099379] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.099498] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.099597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.099656] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.249600] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.249715] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.250076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.250429] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.250429] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.250570] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.251035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.251035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.251035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.251035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.251035] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 is going to be updated. [ 994.292294] env[65322]: INFO networking_nsxv3.common.synchronization [req-fb5ad632-b8a2-4e3e-a4a9-c075eef1e9ff req-447464a8-cebe-46ae-9e86-20f29b1e923c tempest-ServerActionsTestOtherB-30032286 tempest-ServerActionsTestOtherB-30032286-project-member] Enqueued Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_members [ 994.292992] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_members [ 994.293406] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-c552e7e9-dc55-4efc-afb8-91a443d0679a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.293538] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.293608] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.293832] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.294089] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.294175] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.294215] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.294378] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.294450] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.294550] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.299669] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.299907] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.299907] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.300042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.300205] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.316066] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 in Status: IN_PROGRESS for 2s [ 994.528044] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.528422] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.528422] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.528760] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.528950] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.529070] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.529239] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.529441] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.529615] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.529779] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.530117] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.605577] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.757170] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-580 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.757170] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-580" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.757170] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-580" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.757170] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-580" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.757170] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.757170] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.757668] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.757668] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.757668] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.757768] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.757873] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.757977] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.758086] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.758186] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.758283] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.758419] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.778785] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.778976] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 994.779132] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.779306] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-580" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.779623] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-b7fcd0b2-acae-41e6-92c1-dd79858708d5 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.779795] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-b7fcd0b2-acae-41e6-92c1-dd79858708d5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.779908] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-b7fcd0b2-acae-41e6-92c1-dd79858708d5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.780768] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-b7fcd0b2-acae-41e6-92c1-dd79858708d5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.780768] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7fcd0b2-acae-41e6-92c1-dd79858708d5',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.800255] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.800255] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.800255] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.800255] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.800255] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.800501] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.800501] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.800682] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.800682] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.800739] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.800854] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c552e7e9-dc55-4efc-afb8-91a443d0679a is going to be updated. [ 994.829920] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.830129] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.830191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.830429] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.830564] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.840289] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: IN_PROGRESS for 2s [ 995.032883] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.033185] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.033312] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.033656] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.033902] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.034125] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.034268] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.034537] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.034627] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.034715] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.034941] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.035065] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.035129] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.035606] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.035606] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.035606] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.035734] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.035831] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.035890] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.035961] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.036184] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.108589] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.283707] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.283968] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.284057] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.284508] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.284695] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.284839] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port b7fcd0b2-acae-41e6-92c1-dd79858708d5 not found, creating... [ 995.285577] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.285577] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.285577] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.285775] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.285921] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.286244] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.286405] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.286521] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.287112] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.287112] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.287253] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: b7fcd0b2-acae-41e6-92c1-dd79858708d5 is going to be created. [ 995.310349] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.310608] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.311085] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.311171] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.311644] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.311644] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-b7fcd0b2-acae-41e6-92c1-dd79858708d5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.538809] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ef78971b-78bd-41bb-9a08-bdae7a3b226a: rpc.has_security_group_logging(os_id): False [ 995.563428] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.563623] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.563699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.563981] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.564130] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.564469] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.564594] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.564680] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.565021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.565021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.565258] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.565383] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.565452] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.565656] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.565740] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.566020] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.566885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.566965] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.567330] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.567330] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.567484] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a is going to be updated. [ 995.611799] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.611799] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.611958] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.612128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.612212] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.612297] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 is going to be updated. [ 995.641615] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.641855] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.642069] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.642352] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.642423] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.647640] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.647640] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.647861] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.647861] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.648167] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.658874] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: IN_PROGRESS for 2s [ 995.666453] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: IN_PROGRESS for 2s [ 995.824583] env[65322]: INFO networking_nsxv3.common.synchronization [req-ccbe1b30-7e2f-45b7-b3c8-421f5be11587 req-3f185463-38c4-4d6b-8b07-ef35af7ea9ad tempest-MultipleCreateTestJSON-731324011 tempest-MultipleCreateTestJSON-731324011-project-member] Enqueued Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_members [ 995.825797] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_members [ 995.826223] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.826392] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.826441] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.826607] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.826755] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.826849] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.826928] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.827155] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.827241] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.827330] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.054229] env[65322]: INFO networking_nsxv3.common.synchronization [req-fb5ad632-b8a2-4e3e-a4a9-c075eef1e9ff req-dd6bc60c-ac24-4f20-b85a-b678ddacdcb6 service nova] Enqueued Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_rules [ 996.054229] env[65322]: INFO networking_nsxv3.common.synchronization [req-fb5ad632-b8a2-4e3e-a4a9-c075eef1e9ff req-dd6bc60c-ac24-4f20-b85a-b678ddacdcb6 service nova] Enqueued Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_members [ 996.054229] env[65322]: INFO networking_nsxv3.common.synchronization [req-fb5ad632-b8a2-4e3e-a4a9-c075eef1e9ff req-dd6bc60c-ac24-4f20-b85a-b678ddacdcb6 service nova] Enqueued Resource ID: b7fcd0b2-acae-41e6-92c1-dd79858708d5 with Priority: HIGHEST for action port [ 996.054229] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_rules [ 996.054229] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_members [ 996.054229] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7fcd0b2-acae-41e6-92c1-dd79858708d5 with Priority: HIGHEST for action port [ 996.056042] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c552e7e9-dc55-4efc-afb8-91a443d0679a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.056042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.056042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.056042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.056042] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.058540] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-c552e7e9-dc55-4efc-afb8-91a443d0679a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.059180] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.060170] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7fcd0b2-acae-41e6-92c1-dd79858708d5 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.060336] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7fcd0b2-acae-41e6-92c1-dd79858708d5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.060448] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7fcd0b2-acae-41e6-92c1-dd79858708d5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.060766] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7fcd0b2-acae-41e6-92c1-dd79858708d5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.060852] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7fcd0b2-acae-41e6-92c1-dd79858708d5',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.184825] env[65322]: INFO networking_nsxv3.common.synchronization [req-bf0c8bf3-8cbc-47b3-acdf-e8f0fffa5c9d req-97b96b6a-3594-41d0-b9d2-56a1c2b9f002 tempest-MultipleCreateTestJSON-731324011 tempest-MultipleCreateTestJSON-731324011-project-member] Enqueued Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_members [ 996.184825] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGHEST for action security_group_members [ 996.185276] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.185536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.326849] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 in Status: SUCCESS [ 996.327026] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 deletion is rescheduled due to dependency. [ 996.327166] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.336035] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.558647] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-c552e7e9-dc55-4efc-afb8-91a443d0679a taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.558861] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.563330] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7fcd0b2-acae-41e6-92c1-dd79858708d5 with status ACTIVE [ 996.563561] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.563909] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.563909] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.564016] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.564050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.565290] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.565290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.565290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.565290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.565290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.565290] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.565290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.565290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.565290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.565290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.565290] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7fcd0b2-acae-41e6-92c1-dd79858708d5 is going to be updated. [ 996.591710] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.591710] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.591710] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.591710] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.591710] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.591710] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7fcd0b2-acae-41e6-92c1-dd79858708d5" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.835806] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.851492] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: SUCCESS [ 996.851687] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c552e7e9-dc55-4efc-afb8-91a443d0679a deletion is rescheduled due to dependency. [ 996.851815] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.852016] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.852300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.852533] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.852707] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.852789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.852987] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.853100] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.853203] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.339489] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.339489] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.339489] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.339689] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.339689] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.339758] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a is going to be updated. [ 997.356496] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.376595] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.376595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.376595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.376595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.376595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.388758] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: IN_PROGRESS for 2s [ 997.672719] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: SUCCESS [ 997.672719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.672719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.672719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.672719] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.672719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.672719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.672719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.672719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.673282] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.673282] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.687183] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: SUCCESS [ 997.687305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.860066] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.176229] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.176473] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.176593] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.177054] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.177481] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.177688] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.177811] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.178151] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.178263] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.178422] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.178671] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.178819] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.178922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.179200] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.179471] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.179675] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.179945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.179945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.180052] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.180147] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.180242] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.362946] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.363453] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.363453] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.363700] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.363788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.363891] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c552e7e9-dc55-4efc-afb8-91a443d0679a is going to be updated. [ 998.397336] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.397529] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.397578] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.397819] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.398471] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.408514] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: IN_PROGRESS for 2s [ 998.682339] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a34cfbc5-e3ce-4943-8058-702a82703915: rpc.has_security_group_logging(os_id): False [ 998.703207] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.703374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.703455] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.703687] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.703757] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.704870] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.704870] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.704870] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.704870] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.704870] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.704870] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.704870] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.704870] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.704870] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.705332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.705332] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.705332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.705332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.705495] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.705495] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.705553] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 is going to be updated. [ 998.774735] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.775699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.775699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.775699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.775699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.797526] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: IN_PROGRESS for 2s [ 999.086603] env[65322]: INFO networking_nsxv3.common.synchronization [req-f915d1fc-78b4-4ffb-a6e9-ec41c117ffaa req-b14c8d5c-f798-4b9f-9709-19eec68e2638 tempest-ServerDiagnosticsTest-127876359 tempest-ServerDiagnosticsTest-127876359-project-member] Enqueued Resource ID: 83773a1e-a41f-4b44-9df1-b3c8d1937490 with Priority: HIGHEST for action security_group_members [ 999.086603] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83773a1e-a41f-4b44-9df1-b3c8d1937490 with Priority: HIGHEST for action security_group_members [ 999.087086] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-83773a1e-a41f-4b44-9df1-b3c8d1937490 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.087086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.087181] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.087371] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.087751] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.087751] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.087751] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.087945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.087945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.088011] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83773a1e-a41f-4b44-9df1-b3c8d1937490',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.205766] env[65322]: INFO networking_nsxv3.common.synchronization [req-8de382eb-218c-4a97-a522-fe33f5edb2b9 req-aea58997-f99d-45a2-be11-e4f9e17959ab tempest-ServersAdminTestJSON-1989503110 tempest-ServersAdminTestJSON-1989503110-project-member] Enqueued Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_members [ 999.207411] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_members [ 999.207934] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.208195] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.208274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.208540] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.208744] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.208829] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.208887] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.209134] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.209218] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.209328] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.400227] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: SUCCESS [ 999.400670] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.400890] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.401175] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.401666] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.401873] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.401968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.402134] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.402227] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.402410] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.566721] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-620 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.566937] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.567076] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.567392] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.567668] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.567822] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.567951] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.568194] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.568340] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.568568] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 999.568681] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 999.568785] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 999.568900] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 999.569033] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 999.569172] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 999.569328] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 999.590350] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 999.590526] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 999.590578] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 999.591051] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.591130] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-a5be0e73-d709-4700-a114-1119e0399304 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.591312] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-a5be0e73-d709-4700-a114-1119e0399304" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.591468] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-a5be0e73-d709-4700-a114-1119e0399304" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.591857] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-a5be0e73-d709-4700-a114-1119e0399304" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.591997] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5be0e73-d709-4700-a114-1119e0399304',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.593478] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.593593] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.593650] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.593839] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.593939] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.594153] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.594244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.594295] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.594533] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.594611] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.594701] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83773a1e-a41f-4b44-9df1-b3c8d1937490 already deleted. [ 999.594803] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.713277] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.907851] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.907851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.907851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.907851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.907851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.907851] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.907851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.907851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.907851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.907851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.907851] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a is going to be updated. [ 999.941244] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.941244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.941244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.941244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.941244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.953398] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: IN_PROGRESS for 2s [ 1000.098946] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.099242] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.099316] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.099599] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.099748] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.099899] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port a5be0e73-d709-4700-a114-1119e0399304 not found, creating... [ 1000.100174] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.100324] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.100437] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.100697] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.100902] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.101192] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.101275] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.101383] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.101641] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.101701] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.101834] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: a5be0e73-d709-4700-a114-1119e0399304 is going to be created. [ 1000.127390] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.127639] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.127780] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.128109] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.128384] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.128648] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-a5be0e73-d709-4700-a114-1119e0399304" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.215991] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.422564] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: SUCCESS [ 1000.422811] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.423010] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.423262] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.423552] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.423666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.423799] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.424109] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.424225] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.424376] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.424508] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.719867] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.719867] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.719867] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.720063] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.720142] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.720264] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 is going to be updated. [ 1000.752238] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.752459] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.752504] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.752709] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.752875] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.766093] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: IN_PROGRESS for 2s [ 1000.827245] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: SUCCESS [ 1000.827607] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.906699] env[65322]: INFO networking_nsxv3.common.synchronization [req-f915d1fc-78b4-4ffb-a6e9-ec41c117ffaa req-10a725e2-a9cd-4045-a228-69c8ff980320 service nova] Enqueued Resource ID: 83773a1e-a41f-4b44-9df1-b3c8d1937490 with Priority: HIGHEST for action security_group_rules [ 1000.907984] env[65322]: INFO networking_nsxv3.common.synchronization [req-f915d1fc-78b4-4ffb-a6e9-ec41c117ffaa req-10a725e2-a9cd-4045-a228-69c8ff980320 service nova] Enqueued Resource ID: 83773a1e-a41f-4b44-9df1-b3c8d1937490 with Priority: HIGHEST for action security_group_members [ 1000.907984] env[65322]: INFO networking_nsxv3.common.synchronization [req-f915d1fc-78b4-4ffb-a6e9-ec41c117ffaa req-10a725e2-a9cd-4045-a228-69c8ff980320 service nova] Enqueued Resource ID: a5be0e73-d709-4700-a114-1119e0399304 with Priority: HIGHEST for action port [ 1000.907984] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83773a1e-a41f-4b44-9df1-b3c8d1937490 with Priority: HIGHEST for action security_group_rules [ 1000.907984] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83773a1e-a41f-4b44-9df1-b3c8d1937490 with Priority: HIGHEST for action security_group_members [ 1000.907984] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5be0e73-d709-4700-a114-1119e0399304 with Priority: HIGHEST for action port [ 1000.908562] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83773a1e-a41f-4b44-9df1-b3c8d1937490 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.908562] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.908562] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.908800] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.908846] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83773a1e-a41f-4b44-9df1-b3c8d1937490',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.911226] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-83773a1e-a41f-4b44-9df1-b3c8d1937490 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.911355] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.911452] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.911604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.911763] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.911914] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.912254] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.912443] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.912537] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.912653] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83773a1e-a41f-4b44-9df1-b3c8d1937490',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.914830] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5be0e73-d709-4700-a114-1119e0399304 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.914830] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5be0e73-d709-4700-a114-1119e0399304" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.914830] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5be0e73-d709-4700-a114-1119e0399304" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.914830] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5be0e73-d709-4700-a114-1119e0399304" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.914830] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5be0e73-d709-4700-a114-1119e0399304',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.926584] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.412596] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-83773a1e-a41f-4b44-9df1-b3c8d1937490 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.412958] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.419557] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5be0e73-d709-4700-a114-1119e0399304 with status ACTIVE [ 1001.419921] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.420044] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.420129] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.420523] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.421589] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.421589] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.421589] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.421589] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.421589] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.421589] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.422060] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.422060] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.422157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.423201] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.423201] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.423201] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5be0e73-d709-4700-a114-1119e0399304 is going to be updated. [ 1001.424443] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('83773a1e-a41f-4b44-9df1-b3c8d1937490',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.430585] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c552e7e9-dc55-4efc-afb8-91a443d0679a: rpc.has_security_group_logging(os_id): False [ 1001.453291] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.453530] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.453530] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.453695] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.453823] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.454178] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.454306] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.454492] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.454725] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.454837] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.454937] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c552e7e9-dc55-4efc-afb8-91a443d0679a is going to be updated. [ 1001.457747] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.457916] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.457983] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.458178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.458318] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.458526] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5be0e73-d709-4700-a114-1119e0399304" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.536108] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.536336] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.536336] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.536691] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.536802] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.555677] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: IN_PROGRESS for 2s [ 1001.928543] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('83773a1e-a41f-4b44-9df1-b3c8d1937490',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.963779] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a in Status: SUCCESS [ 1001.963939] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a deletion is rescheduled due to dependency. [ 1001.964077] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.430762] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.431032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.431032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.431241] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.431326] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.431430] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83773a1e-a41f-4b44-9df1-b3c8d1937490 is going to be created. [ 1002.477220] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.477366] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.477438] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.477680] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.478284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.489464] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83773a1e-a41f-4b44-9df1-b3c8d1937490 in Status: UNINITIALIZED for 2s [ 1002.779234] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: SUCCESS [ 1002.779450] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.569525] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: SUCCESS [ 1003.569870] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.502598] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83773a1e-a41f-4b44-9df1-b3c8d1937490 in Status: SUCCESS [ 1004.503412] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.503412] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.503412] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.503762] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.503762] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.503762] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.503931] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.503974] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.504092] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.504182] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('83773a1e-a41f-4b44-9df1-b3c8d1937490',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.006486] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-83773a1e-a41f-4b44-9df1-b3c8d1937490 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.006770] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.006770] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.006966] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.007438] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.008357] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.008472] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.008769] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.009127] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.009461] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.009894] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-83773a1e-a41f-4b44-9df1-b3c8d1937490 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.010019] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.010076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.010589] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.010663] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.010790] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.010912] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.011095] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.011198] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.011301] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.011407] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('83773a1e-a41f-4b44-9df1-b3c8d1937490',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.513531] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 83773a1e-a41f-4b44-9df1-b3c8d1937490: rpc.has_security_group_logging(os_id): False [ 1005.534754] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.534925] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.534991] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.535269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.535391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.535659] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.535813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.537067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.537067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.537067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.537067] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.537067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.537067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.537067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.537067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.537566] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.538254] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.538254] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.538254] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.538254] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.538254] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83773a1e-a41f-4b44-9df1-b3c8d1937490 is going to be created. [ 1005.622659] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.622814] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.622814] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.622994] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.623179] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.642334] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83773a1e-a41f-4b44-9df1-b3c8d1937490 in Status: IN_PROGRESS for 2s [ 1005.909122] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1005.909267] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1007.657433] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 83773a1e-a41f-4b44-9df1-b3c8d1937490 in Status: SUCCESS [ 1007.658113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.319975] env[65322]: INFO networking_nsxv3.common.synchronization [None req-115badc9-e081-40b0-aa41-fb3ae8e4ccb9 None None] Enqueued Resource ID: 2fbf702d-4f38-476d-9d67-2956701e6ea1 with Priority: HIGHEST for action port [ 1009.320754] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fbf702d-4f38-476d-9d67-2956701e6ea1 with Priority: HIGHEST for action port [ 1009.320754] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fbf702d-4f38-476d-9d67-2956701e6ea1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.320754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fbf702d-4f38-476d-9d67-2956701e6ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.320754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fbf702d-4f38-476d-9d67-2956701e6ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.321260] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fbf702d-4f38-476d-9d67-2956701e6ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.321357] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fbf702d-4f38-476d-9d67-2956701e6ea1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.827383] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2fbf702d-4f38-476d-9d67-2956701e6ea1 [ 1009.827383] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.827383] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.827383] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.827383] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.827383] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.827383] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2fbf702d-4f38-476d-9d67-2956701e6ea1 already deleted. [ 1009.827383] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fbf702d-4f38-476d-9d67-2956701e6ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.505876] env[65322]: INFO networking_nsxv3.common.synchronization [None req-5867821c-db16-49e4-aef3-2fc0175c349d None None] Enqueued Resource ID: ed8fa147-f38f-40eb-addd-d7a266795cf6 with Priority: HIGHEST for action port [ 1011.506417] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed8fa147-f38f-40eb-addd-d7a266795cf6 with Priority: HIGHEST for action port [ 1011.506809] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed8fa147-f38f-40eb-addd-d7a266795cf6 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.506936] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed8fa147-f38f-40eb-addd-d7a266795cf6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.506936] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed8fa147-f38f-40eb-addd-d7a266795cf6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.507438] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed8fa147-f38f-40eb-addd-d7a266795cf6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.507524] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed8fa147-f38f-40eb-addd-d7a266795cf6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.010261] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed8fa147-f38f-40eb-addd-d7a266795cf6 [ 1012.010261] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.011241] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.011241] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.011241] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.011241] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.011241] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed8fa147-f38f-40eb-addd-d7a266795cf6 already deleted. [ 1012.011241] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed8fa147-f38f-40eb-addd-d7a266795cf6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.113611] env[65322]: INFO networking_nsxv3.common.synchronization [None req-f01f5e28-be00-4ba4-b047-6d5be78e304f None None] Enqueued Resource ID: 105f3f5a-858d-4fa7-b7bb-7a00c00b46a8 with Priority: HIGHEST for action port [ 1012.113611] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 105f3f5a-858d-4fa7-b7bb-7a00c00b46a8 with Priority: HIGHEST for action port [ 1012.113763] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-105f3f5a-858d-4fa7-b7bb-7a00c00b46a8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.113908] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-105f3f5a-858d-4fa7-b7bb-7a00c00b46a8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.113972] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-105f3f5a-858d-4fa7-b7bb-7a00c00b46a8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.117106] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-105f3f5a-858d-4fa7-b7bb-7a00c00b46a8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.117106] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('105f3f5a-858d-4fa7-b7bb-7a00c00b46a8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.621415] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 105f3f5a-858d-4fa7-b7bb-7a00c00b46a8 [ 1012.621415] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.621415] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.621415] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.622220] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.622220] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.622220] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:105f3f5a-858d-4fa7-b7bb-7a00c00b46a8 already deleted. [ 1012.622220] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-105f3f5a-858d-4fa7-b7bb-7a00c00b46a8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.003349] env[65322]: INFO networking_nsxv3.common.synchronization [None req-62a51041-98b0-4e5b-98bf-f39b063d8cd9 tempest-AttachInterfacesTestJSON-353803948 tempest-AttachInterfacesTestJSON-353803948-project-member] Enqueued Resource ID: 108c844e-abaf-4512-b72b-84435bbf4e4e with Priority: HIGHEST for action security_group_rules [ 1014.006026] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108c844e-abaf-4512-b72b-84435bbf4e4e with Priority: HIGHEST for action security_group_rules [ 1014.007450] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-108c844e-abaf-4512-b72b-84435bbf4e4e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.008311] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.008311] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.008311] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.008311] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('108c844e-abaf-4512-b72b-84435bbf4e4e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.105238] env[65322]: INFO networking_nsxv3.common.synchronization [None req-2213a5bf-9af7-4209-aa60-debe704e661a None None] Enqueued Resource ID: 6681a6e6-c6ef-40fb-a57e-3b9aee94a3a9 with Priority: HIGHEST for action port [ 1014.105664] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6681a6e6-c6ef-40fb-a57e-3b9aee94a3a9 with Priority: HIGHEST for action port [ 1014.106274] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-6681a6e6-c6ef-40fb-a57e-3b9aee94a3a9 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.107165] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6681a6e6-c6ef-40fb-a57e-3b9aee94a3a9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.107165] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6681a6e6-c6ef-40fb-a57e-3b9aee94a3a9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.107428] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6681a6e6-c6ef-40fb-a57e-3b9aee94a3a9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.107507] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6681a6e6-c6ef-40fb-a57e-3b9aee94a3a9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.121979] env[65322]: INFO networking_nsxv3.common.synchronization [None req-bf0ef13f-e742-486e-955f-3f36f2d7b8e9 tempest-AttachInterfacesTestJSON-353803948 tempest-AttachInterfacesTestJSON-353803948-project-member] Enqueued Resource ID: 108c844e-abaf-4512-b72b-84435bbf4e4e with Priority: HIGHEST for action security_group_rules [ 1014.121979] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108c844e-abaf-4512-b72b-84435bbf4e4e with Priority: HIGHEST for action security_group_rules [ 1014.121979] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-108c844e-abaf-4512-b72b-84435bbf4e4e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.121979] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.491096] env[65322]: INFO networking_nsxv3.common.synchronization [None req-20b1d31a-196e-4ccd-a338-261710c5ae03 None None] Enqueued Resource ID: 5db433a2-b9db-47cf-bc26-7cb550c891d9 with Priority: HIGHEST for action port [ 1014.491096] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db433a2-b9db-47cf-bc26-7cb550c891d9 with Priority: HIGHEST for action port [ 1014.491096] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-5db433a2-b9db-47cf-bc26-7cb550c891d9 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.491937] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5db433a2-b9db-47cf-bc26-7cb550c891d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.491937] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5db433a2-b9db-47cf-bc26-7cb550c891d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.491937] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5db433a2-b9db-47cf-bc26-7cb550c891d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.491937] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5db433a2-b9db-47cf-bc26-7cb550c891d9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.533468] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.533699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.533784] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.534090] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.534458] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.534636] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 108c844e-abaf-4512-b72b-84435bbf4e4e already deleted. [ 1014.534730] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.534895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.535096] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.535181] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('108c844e-abaf-4512-b72b-84435bbf4e4e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.550322] env[65322]: INFO networking_nsxv3.common.synchronization [None req-99d2dc67-27cd-4fa0-a13e-9cf5b7ba3bf4 tempest-AttachVolumeNegativeTest-885508175 tempest-AttachVolumeNegativeTest-885508175-project-member] Enqueued Resource ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 with Priority: HIGHEST for action security_group_rules [ 1014.550939] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 with Priority: HIGHEST for action security_group_rules [ 1014.551298] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ce3cc37-b73f-4ecb-b24a-2b06775793e8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.551464] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.551514] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.552066] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.552066] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ce3cc37-b73f-4ecb-b24a-2b06775793e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.610943] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6681a6e6-c6ef-40fb-a57e-3b9aee94a3a9 [ 1014.610943] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.610943] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.610943] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.611290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.612144] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.612275] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6681a6e6-c6ef-40fb-a57e-3b9aee94a3a9 already deleted. [ 1014.612360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6681a6e6-c6ef-40fb-a57e-3b9aee94a3a9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.725411] env[65322]: INFO networking_nsxv3.common.synchronization [None req-21132ab9-506c-4b56-ac80-c60045dc443c tempest-AttachVolumeNegativeTest-885508175 tempest-AttachVolumeNegativeTest-885508175-project-member] Enqueued Resource ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 with Priority: HIGHEST for action security_group_rules [ 1014.726032] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 with Priority: HIGHEST for action security_group_rules [ 1014.726529] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ce3cc37-b73f-4ecb-b24a-2b06775793e8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.726529] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.994425] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5db433a2-b9db-47cf-bc26-7cb550c891d9 [ 1014.994425] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.994425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.994425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.994674] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.994750] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.994829] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5db433a2-b9db-47cf-bc26-7cb550c891d9 already deleted. [ 1014.994905] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5db433a2-b9db-47cf-bc26-7cb550c891d9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.061098] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.062296] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.062296] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.062296] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.062296] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.062296] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 108c844e-abaf-4512-b72b-84435bbf4e4e already deleted. [ 1015.062296] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.076267] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.076483] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.076483] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.076707] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.076844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.077080] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 already deleted. [ 1015.077080] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.077253] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.077367] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.077461] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ce3cc37-b73f-4ecb-b24a-2b06775793e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.606028] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.606243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.606317] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.606514] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.606609] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.606710] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 already deleted. [ 1015.606799] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.068118] env[65322]: INFO networking_nsxv3.common.synchronization [req-a72949dc-491f-480f-9c29-3aa40b540ff1 req-13d9ef02-844e-4657-a630-bccb3e0f0eb8 tempest-ServerDiagnosticsTest-127876359 tempest-ServerDiagnosticsTest-127876359-project-member] Enqueued Resource ID: 83773a1e-a41f-4b44-9df1-b3c8d1937490 with Priority: HIGHEST for action security_group_members [ 1016.068672] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83773a1e-a41f-4b44-9df1-b3c8d1937490 with Priority: HIGHEST for action security_group_members [ 1016.070229] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-83773a1e-a41f-4b44-9df1-b3c8d1937490 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.070229] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.070229] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.070421] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.070586] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.070693] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.070766] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.071152] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.071152] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.071152] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('83773a1e-a41f-4b44-9df1-b3c8d1937490',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.409884] env[65322]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1016.410044] env[65322]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] NSXv3 Agent Agent loop - iteration:2 started [ 1016.573674] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.573674] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.574046] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.574046] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.574046] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.574241] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.574340] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.574403] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.575656] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.575790] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.575896] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83773a1e-a41f-4b44-9df1-b3c8d1937490 is going to be updated. [ 1016.621879] env[65322]: INFO networking_nsxv3.common.synchronization [None req-f5d3f109-44e3-4d07-8110-e51b2eb98223 tempest-ServerActionsTestJSON-71326710 tempest-ServerActionsTestJSON-71326710-project-member] Enqueued Resource ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 with Priority: HIGHEST for action security_group_rules [ 1016.622510] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 with Priority: HIGHEST for action security_group_rules [ 1016.622839] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.622955] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.625035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.625448] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.625535] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.640360] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.640360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.640360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.640360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.640360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.649895] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83773a1e-a41f-4b44-9df1-b3c8d1937490 in Status: IN_PROGRESS for 2s [ 1016.812041] env[65322]: INFO networking_nsxv3.common.synchronization [None req-3d8a3132-51c1-4840-9e84-d1237d820540 tempest-ServerActionsTestJSON-71326710 tempest-ServerActionsTestJSON-71326710-project-member] Enqueued Resource ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 with Priority: HIGHEST for action security_group_rules [ 1016.812609] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 with Priority: HIGHEST for action security_group_rules [ 1016.812922] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.813034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.128792] env[65322]: INFO networking_nsxv3.common.synchronization [None req-6b7d1c15-fa61-4749-9625-0accd91c70cb None None] Enqueued Resource ID: 2b46410a-e936-4079-8db0-2170046ba364 with Priority: HIGHEST for action port [ 1017.130514] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b46410a-e936-4079-8db0-2170046ba364 with Priority: HIGHEST for action port [ 1017.130724] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b46410a-e936-4079-8db0-2170046ba364 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.130848] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b46410a-e936-4079-8db0-2170046ba364" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.131373] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b46410a-e936-4079-8db0-2170046ba364" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.131373] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b46410a-e936-4079-8db0-2170046ba364" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.131373] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b46410a-e936-4079-8db0-2170046ba364',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.151180] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.151180] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.151180] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.151723] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.151723] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.151723] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 already deleted. [ 1017.151723] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.152757] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.152757] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.152757] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.633200] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b46410a-e936-4079-8db0-2170046ba364 [ 1017.633434] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.633569] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.633640] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.633869] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.633984] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.634066] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b46410a-e936-4079-8db0-2170046ba364 already deleted. [ 1017.634148] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b46410a-e936-4079-8db0-2170046ba364" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.672892] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.673213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.673366] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.673658] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.673828] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.673997] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 already deleted. [ 1017.674170] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.661712] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 83773a1e-a41f-4b44-9df1-b3c8d1937490 in Status: SUCCESS [ 1018.661712] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 83773a1e-a41f-4b44-9df1-b3c8d1937490 deletion is rescheduled due to dependency. [ 1018.661712] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.099042] env[65322]: INFO networking_nsxv3.common.synchronization [None req-7de8d236-f09f-4356-a899-1af6b48bdd98 None None] Enqueued Resource ID: 8d6dc611-b81d-485e-9dc5-3794a450858a with Priority: HIGHEST for action port [ 1020.099042] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d6dc611-b81d-485e-9dc5-3794a450858a with Priority: HIGHEST for action port [ 1020.099393] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-8d6dc611-b81d-485e-9dc5-3794a450858a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.099563] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8d6dc611-b81d-485e-9dc5-3794a450858a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.099624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8d6dc611-b81d-485e-9dc5-3794a450858a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.100580] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8d6dc611-b81d-485e-9dc5-3794a450858a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.100580] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8d6dc611-b81d-485e-9dc5-3794a450858a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.603531] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8d6dc611-b81d-485e-9dc5-3794a450858a [ 1020.603775] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.603906] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.604096] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.604270] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.604448] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.604448] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8d6dc611-b81d-485e-9dc5-3794a450858a already deleted. [ 1020.604688] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8d6dc611-b81d-485e-9dc5-3794a450858a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.360344] env[65322]: INFO networking_nsxv3.common.synchronization [req-cb6fa328-13b3-4658-bd27-d6401ec43c07 req-4a438253-5318-476e-8619-08873e9f9f62 tempest-ServersAdminTestJSON-1989503110 tempest-ServersAdminTestJSON-1989503110-project-member] Enqueued Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_members [ 1021.361482] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_members [ 1021.362360] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.362499] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.362570] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.362772] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.362937] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.364482] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.364595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.364796] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.365631] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.365631] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.870071] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.372143] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.636570] env[65322]: INFO networking_nsxv3.common.synchronization [None req-33c0c6cf-f63a-4743-966d-86274c253386 None None] Enqueued Resource ID: 4bf397ca-d282-4362-a044-2c65d2cd42c3 with Priority: HIGHEST for action port [ 1022.637099] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bf397ca-d282-4362-a044-2c65d2cd42c3 with Priority: HIGHEST for action port [ 1022.637447] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bf397ca-d282-4362-a044-2c65d2cd42c3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.637585] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bf397ca-d282-4362-a044-2c65d2cd42c3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.637653] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bf397ca-d282-4362-a044-2c65d2cd42c3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.637899] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bf397ca-d282-4362-a044-2c65d2cd42c3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.637983] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bf397ca-d282-4362-a044-2c65d2cd42c3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.874946] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.874946] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.874946] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.874946] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.874946] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.875292] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 is going to be updated. [ 1022.903768] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.903938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.904022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.904258] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.904425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.914422] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: IN_PROGRESS for 2s [ 1023.140617] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4bf397ca-d282-4362-a044-2c65d2cd42c3 [ 1023.140964] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.141230] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.141333] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.141556] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.141647] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.141752] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4bf397ca-d282-4362-a044-2c65d2cd42c3 already deleted. [ 1023.141875] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bf397ca-d282-4362-a044-2c65d2cd42c3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.581589] env[65322]: INFO networking_nsxv3.common.synchronization [req-14ce65c9-fc5f-4727-b7c2-7f2cef12a244 req-9c69a261-300b-4de7-ac2f-1b0357221d9e tempest-DeleteServersTestJSON-1463403857 tempest-DeleteServersTestJSON-1463403857-project-member] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 1024.582831] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 1024.582831] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.582831] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.582831] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.582831] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.584285] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.584397] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.584447] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.586073] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.586176] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.586277] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.926374] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: SUCCESS [ 1024.926616] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.088830] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.088944] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.089066] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.089246] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.089362] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.089525] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.089626] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.089694] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.089834] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.089902] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.089986] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be updated. [ 1025.121415] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.121880] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.121880] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.122017] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.122165] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.131418] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: IN_PROGRESS for 2s [ 1027.146594] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: SUCCESS [ 1027.147206] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 deletion is rescheduled due to dependency. [ 1027.147324] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.967573] env[65322]: INFO networking_nsxv3.common.synchronization [req-f17e825b-5094-4410-9e92-936abc09447c req-ff967493-009e-46be-9edb-cb446183249b tempest-DeleteServersAdminTestJSON-810815226 tempest-DeleteServersAdminTestJSON-810815226-project-member] Enqueued Resource ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e with Priority: HIGHEST for action security_group_members [ 1028.968135] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e with Priority: HIGHEST for action security_group_members [ 1028.968437] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.968559] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.968624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.968831] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.968982] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.969091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.969160] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.969294] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.969376] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.969464] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc4077b8-3a0e-4709-8542-93ed5e2bc81e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.298195] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-620 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.298359] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.298525] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.298946] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.298946] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.299150] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.299471] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.299471] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.299616] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.299839] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.300146] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1029.300808] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1029.300951] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1029.301088] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.301322] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1029.301322] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1029.346211] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1029.346385] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.045 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1029.346521] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1029.346704] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-620" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.347063] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-2b67fac8-df30-41b3-bcc6-70e62970dc9f taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.347237] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-2b67fac8-df30-41b3-bcc6-70e62970dc9f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.347357] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-2b67fac8-df30-41b3-bcc6-70e62970dc9f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.347679] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-2b67fac8-df30-41b3-bcc6-70e62970dc9f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.347817] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b67fac8-df30-41b3-bcc6-70e62970dc9f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.472385] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.472532] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.472532] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.472758] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.472798] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.475325] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.475325] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.475325] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.475325] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.475325] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.475325] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e is going to be updated. [ 1029.499498] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.499639] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.499712] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.499925] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.500086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.509287] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e in Status: IN_PROGRESS for 2s [ 1029.850811] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.851092] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.851206] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.851493] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.851714] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.851892] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 2b67fac8-df30-41b3-bcc6-70e62970dc9f not found, creating... [ 1029.852172] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.852327] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.852439] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.852716] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.852867] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.853157] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.853308] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.853421] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.853633] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.853764] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.853987] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 2b67fac8-df30-41b3-bcc6-70e62970dc9f is going to be created. [ 1029.875802] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.876037] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.876139] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.876409] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.876631] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.876886] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-2b67fac8-df30-41b3-bcc6-70e62970dc9f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.571471] env[65322]: INFO networking_nsxv3.common.synchronization [req-f17e825b-5094-4410-9e92-936abc09447c req-3c6db668-f31c-4b83-99da-d6907d87f8ef service nova] Enqueued Resource ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e with Priority: HIGHEST for action security_group_rules [ 1030.571741] env[65322]: INFO networking_nsxv3.common.synchronization [req-f17e825b-5094-4410-9e92-936abc09447c req-3c6db668-f31c-4b83-99da-d6907d87f8ef service nova] Enqueued Resource ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e with Priority: HIGHEST for action security_group_members [ 1030.571741] env[65322]: INFO networking_nsxv3.common.synchronization [req-f17e825b-5094-4410-9e92-936abc09447c req-3c6db668-f31c-4b83-99da-d6907d87f8ef service nova] Enqueued Resource ID: 2b67fac8-df30-41b3-bcc6-70e62970dc9f with Priority: HIGHEST for action port [ 1030.572341] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e with Priority: HIGHEST for action security_group_rules [ 1030.572513] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e with Priority: HIGHEST for action security_group_members [ 1030.573402] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b67fac8-df30-41b3-bcc6-70e62970dc9f with Priority: HIGHEST for action port [ 1030.573402] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc4077b8-3a0e-4709-8542-93ed5e2bc81e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.573402] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.573402] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.573402] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.573835] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc4077b8-3a0e-4709-8542-93ed5e2bc81e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.574335] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.575243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.575243] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b67fac8-df30-41b3-bcc6-70e62970dc9f taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.575243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b67fac8-df30-41b3-bcc6-70e62970dc9f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.575243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b67fac8-df30-41b3-bcc6-70e62970dc9f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.575243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b67fac8-df30-41b3-bcc6-70e62970dc9f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.575243] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b67fac8-df30-41b3-bcc6-70e62970dc9f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.078070] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.078070] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.078070] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b67fac8-df30-41b3-bcc6-70e62970dc9f with status ACTIVE [ 1031.078070] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.078070] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.078070] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.078447] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.078447] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.078447] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.078563] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.078563] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.078693] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.078768] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.078942] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.079047] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.079102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.079241] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.079314] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.079394] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b67fac8-df30-41b3-bcc6-70e62970dc9f is going to be updated. [ 1031.100754] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.101024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.101024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.101187] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.101320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.101473] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b67fac8-df30-41b3-bcc6-70e62970dc9f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.426844] env[65322]: INFO networking_nsxv3.common.synchronization [req-6c6d6584-7445-40ff-a72f-f865b206539f req-d4716de6-e671-473f-beba-ccf141a2b34f tempest-ServerTagsTestJSON-102347801 tempest-ServerTagsTestJSON-102347801-project-member] Enqueued Resource ID: eaa0f90e-1315-418b-970b-11723b551de1 with Priority: HIGHEST for action security_group_members [ 1031.427535] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa0f90e-1315-418b-970b-11723b551de1 with Priority: HIGHEST for action security_group_members [ 1031.427951] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa0f90e-1315-418b-970b-11723b551de1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.428141] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.428238] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.428568] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.428772] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.428901] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.428986] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.429189] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.429321] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.429419] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaa0f90e-1315-418b-970b-11723b551de1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.520056] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e in Status: SUCCESS [ 1031.520056] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e deletion is rescheduled due to dependency. [ 1031.520056] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.520056] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.520056] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.520527] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.520527] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.520527] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.520527] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.520696] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.520696] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc4077b8-3a0e-4709-8542-93ed5e2bc81e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.777851] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-383 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.778225] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-383" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.778225] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-383" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.778515] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-383" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.778786] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.778944] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.779155] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.779419] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.779593] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.779828] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1031.779990] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1031.780152] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1031.780278] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1031.780421] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1031.780548] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1031.780701] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1031.802223] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1031.802415] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1031.802559] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1031.802760] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-383" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.803156] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-6d5daa62-a291-4b55-8708-c8f794aff25f taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.803558] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-6d5daa62-a291-4b55-8708-c8f794aff25f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.803558] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-6d5daa62-a291-4b55-8708-c8f794aff25f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.804281] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-6d5daa62-a291-4b55-8708-c8f794aff25f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.804281] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d5daa62-a291-4b55-8708-c8f794aff25f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.932539] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.932794] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.932863] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.935631] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.935631] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.935631] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.935631] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.935631] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.935631] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.935631] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.935631] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaa0f90e-1315-418b-970b-11723b551de1 already deleted. [ 1031.935631] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.023774] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fc4077b8-3a0e-4709-8542-93ed5e2bc81e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.307263] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.307492] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.307610] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.307894] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.308060] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.308214] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 6d5daa62-a291-4b55-8708-c8f794aff25f not found, creating... [ 1032.308461] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.308611] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.308723] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.308944] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.309111] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.309357] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.309521] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.309611] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.309822] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.309927] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.310168] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 6d5daa62-a291-4b55-8708-c8f794aff25f is going to be created. [ 1032.332826] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.332826] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.332826] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.332826] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.332826] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.332826] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-6d5daa62-a291-4b55-8708-c8f794aff25f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.526265] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fc4077b8-3a0e-4709-8542-93ed5e2bc81e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.028519] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.028994] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.028994] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.028994] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.028994] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.029214] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e is going to be updated. [ 1033.045904] env[65322]: INFO networking_nsxv3.common.synchronization [req-6c6d6584-7445-40ff-a72f-f865b206539f req-540849e4-e91d-48c7-8f6e-c788aa789e6f service nova] Enqueued Resource ID: eaa0f90e-1315-418b-970b-11723b551de1 with Priority: HIGHEST for action security_group_rules [ 1033.046101] env[65322]: INFO networking_nsxv3.common.synchronization [req-6c6d6584-7445-40ff-a72f-f865b206539f req-540849e4-e91d-48c7-8f6e-c788aa789e6f service nova] Enqueued Resource ID: eaa0f90e-1315-418b-970b-11723b551de1 with Priority: HIGHEST for action security_group_members [ 1033.046242] env[65322]: INFO networking_nsxv3.common.synchronization [req-6c6d6584-7445-40ff-a72f-f865b206539f req-540849e4-e91d-48c7-8f6e-c788aa789e6f service nova] Enqueued Resource ID: 6d5daa62-a291-4b55-8708-c8f794aff25f with Priority: HIGHEST for action port [ 1033.046733] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa0f90e-1315-418b-970b-11723b551de1 with Priority: HIGHEST for action security_group_rules [ 1033.046863] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa0f90e-1315-418b-970b-11723b551de1 with Priority: HIGHEST for action security_group_members [ 1033.046955] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d5daa62-a291-4b55-8708-c8f794aff25f with Priority: HIGHEST for action port [ 1033.047324] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eaa0f90e-1315-418b-970b-11723b551de1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.047469] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.047509] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.047757] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.047824] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eaa0f90e-1315-418b-970b-11723b551de1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.048643] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa0f90e-1315-418b-970b-11723b551de1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.048771] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.048840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.049014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.049802] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.049802] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.049802] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.049802] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.049802] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.049802] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaa0f90e-1315-418b-970b-11723b551de1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.050606] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d5daa62-a291-4b55-8708-c8f794aff25f taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.050743] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d5daa62-a291-4b55-8708-c8f794aff25f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.050796] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d5daa62-a291-4b55-8708-c8f794aff25f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.050965] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d5daa62-a291-4b55-8708-c8f794aff25f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.051019] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d5daa62-a291-4b55-8708-c8f794aff25f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.060176] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.060313] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.060383] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.060814] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.060814] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.070098] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e in Status: IN_PROGRESS for 2s [ 1033.552460] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa0f90e-1315-418b-970b-11723b551de1 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.552670] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.553046] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eaa0f90e-1315-418b-970b-11723b551de1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.554126] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d5daa62-a291-4b55-8708-c8f794aff25f with status ACTIVE [ 1033.554329] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.554467] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.554600] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.554828] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.554965] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.555173] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.555287] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.555363] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.555556] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.555637] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.555860] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.555978] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.556071] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.556244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.556528] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.556528] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d5daa62-a291-4b55-8708-c8f794aff25f is going to be updated. [ 1033.577194] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.577339] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.577388] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.577590] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.577721] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.577875] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d5daa62-a291-4b55-8708-c8f794aff25f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.912380] env[65322]: INFO networking_nsxv3.common.synchronization [req-d35a7fa3-aa6f-4931-a4c5-113dd21a2a83 req-1ea483fa-8aad-4893-bee3-63ff003e0d6f tempest-ServerAddressesTestJSON-611118058 tempest-ServerAddressesTestJSON-611118058-project-member] Enqueued Resource ID: 1910b456-4028-4614-b7d7-a391136f7ea1 with Priority: HIGHEST for action security_group_members [ 1033.913380] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1910b456-4028-4614-b7d7-a391136f7ea1 with Priority: HIGHEST for action security_group_members [ 1033.913380] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1910b456-4028-4614-b7d7-a391136f7ea1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.913380] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.913380] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.913603] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.913712] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.913874] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.913874] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.914013] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.914095] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.914179] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1910b456-4028-4614-b7d7-a391136f7ea1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.059082] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eaa0f90e-1315-418b-970b-11723b551de1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.267399] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-627 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.267628] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-627" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.267758] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-627" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.268111] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-627" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.268366] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.268542] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.268687] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.268934] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.269148] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.269398] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.269544] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1034.269683] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1034.269840] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1034.270022] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1034.270171] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1034.270330] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1034.301449] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1034.301826] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1034.301908] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1034.302109] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-627" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.302442] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-0a1991a2-3d9d-4099-988a-960d660084a9 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.302638] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-0a1991a2-3d9d-4099-988a-960d660084a9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.302843] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-0a1991a2-3d9d-4099-988a-960d660084a9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.303920] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-0a1991a2-3d9d-4099-988a-960d660084a9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.303920] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a1991a2-3d9d-4099-988a-960d660084a9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.417213] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.417213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.417213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.417213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.417213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.417213] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.417213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.417683] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.417683] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.417683] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.417683] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1910b456-4028-4614-b7d7-a391136f7ea1 already deleted. [ 1034.417683] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.561212] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.561379] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.561496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.561750] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.562302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.562302] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaa0f90e-1315-418b-970b-11723b551de1 is going to be created. [ 1034.587594] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.587802] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.587802] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.588011] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.588179] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.599517] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa0f90e-1315-418b-970b-11723b551de1 in Status: UNINITIALIZED for 2s [ 1034.806284] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.806483] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.806577] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.806863] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.807067] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.807187] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 0a1991a2-3d9d-4099-988a-960d660084a9 not found, creating... [ 1034.807444] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.807595] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.807704] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.807969] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.808124] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.808397] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.808548] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.808661] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.808862] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.808992] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.809139] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 0a1991a2-3d9d-4099-988a-960d660084a9 is going to be created. [ 1034.827633] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.827826] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.828032] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.828304] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.828529] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.828739] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-0a1991a2-3d9d-4099-988a-960d660084a9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.081024] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e in Status: SUCCESS [ 1035.081423] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.081480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.081683] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.082123] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.082123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.082123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.082346] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.082346] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.082441] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.082495] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fc4077b8-3a0e-4709-8542-93ed5e2bc81e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.570385] env[65322]: INFO networking_nsxv3.common.synchronization [req-d35a7fa3-aa6f-4931-a4c5-113dd21a2a83 req-5b972c01-ea5a-4ff4-b973-86597c146e2c service nova] Enqueued Resource ID: 1910b456-4028-4614-b7d7-a391136f7ea1 with Priority: HIGHEST for action security_group_rules [ 1035.570385] env[65322]: INFO networking_nsxv3.common.synchronization [req-d35a7fa3-aa6f-4931-a4c5-113dd21a2a83 req-5b972c01-ea5a-4ff4-b973-86597c146e2c service nova] Enqueued Resource ID: 1910b456-4028-4614-b7d7-a391136f7ea1 with Priority: HIGHEST for action security_group_members [ 1035.570527] env[65322]: INFO networking_nsxv3.common.synchronization [req-d35a7fa3-aa6f-4931-a4c5-113dd21a2a83 req-5b972c01-ea5a-4ff4-b973-86597c146e2c service nova] Enqueued Resource ID: 0a1991a2-3d9d-4099-988a-960d660084a9 with Priority: HIGHEST for action port [ 1035.571104] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1910b456-4028-4614-b7d7-a391136f7ea1 with Priority: HIGHEST for action security_group_rules [ 1035.571245] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1910b456-4028-4614-b7d7-a391136f7ea1 with Priority: HIGHEST for action security_group_members [ 1035.571341] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a1991a2-3d9d-4099-988a-960d660084a9 with Priority: HIGHEST for action port [ 1035.571615] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1910b456-4028-4614-b7d7-a391136f7ea1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.571731] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.571795] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.572497] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.572601] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1910b456-4028-4614-b7d7-a391136f7ea1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.574771] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1910b456-4028-4614-b7d7-a391136f7ea1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.574771] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.574771] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.574910] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.575446] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.575559] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.576058] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.576827] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.576827] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.576827] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1910b456-4028-4614-b7d7-a391136f7ea1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.577562] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a1991a2-3d9d-4099-988a-960d660084a9 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.577699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a1991a2-3d9d-4099-988a-960d660084a9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.577767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a1991a2-3d9d-4099-988a-960d660084a9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.577923] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a1991a2-3d9d-4099-988a-960d660084a9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.577998] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a1991a2-3d9d-4099-988a-960d660084a9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.585040] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.585161] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.585228] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.585400] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.585608] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.585723] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.585925] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.586103] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.586191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.586283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.586441] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.586533] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.586592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.586727] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.586859] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.586949] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.587016] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.587183] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.587264] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.587346] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.587428] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fc4077b8-3a0e-4709-8542-93ed5e2bc81e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.080183] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1910b456-4028-4614-b7d7-a391136f7ea1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.081978] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1910b456-4028-4614-b7d7-a391136f7ea1 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.081978] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.081978] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a1991a2-3d9d-4099-988a-960d660084a9 with status ACTIVE [ 1036.081978] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.081978] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.081978] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.083250] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.083250] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.083250] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.083250] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.083250] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.083250] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.083250] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.083250] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.083250] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.083250] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.083250] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.083250] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.083250] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a1991a2-3d9d-4099-988a-960d660084a9 is going to be updated. [ 1036.089367] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fc4077b8-3a0e-4709-8542-93ed5e2bc81e: rpc.has_security_group_logging(os_id): False [ 1036.110027] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.110541] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.112304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.112304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.112304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.112304] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.112304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.112304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.112304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.112304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.112304] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.112304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.112304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.112304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.112304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.112304] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.113178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.113947] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.115165] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.115269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.115371] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e is going to be updated. [ 1036.117332] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.117430] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.117487] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.117619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.117752] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.117996] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a1991a2-3d9d-4099-988a-960d660084a9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.185439] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.185617] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.185683] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.185949] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.186395] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.212064] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e in Status: IN_PROGRESS for 2s [ 1036.587351] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1910b456-4028-4614-b7d7-a391136f7ea1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.610690] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa0f90e-1315-418b-970b-11723b551de1 in Status: SUCCESS [ 1036.610901] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.611369] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.611578] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.611767] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.611941] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.611941] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.612635] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.612635] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.612635] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.612635] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eaa0f90e-1315-418b-970b-11723b551de1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.089417] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.089766] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.089766] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.089890] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.090018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.090086] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1910b456-4028-4614-b7d7-a391136f7ea1 is going to be created. [ 1037.114092] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.114318] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.114406] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.114699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.114978] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.116562] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa0f90e-1315-418b-970b-11723b551de1 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.116886] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.116886] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.117306] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.117306] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.117454] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.117454] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.117622] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.117622] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.117722] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.117879] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa0f90e-1315-418b-970b-11723b551de1 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.117978] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.118048] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.118229] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.118428] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.118513] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.118564] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.118942] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.118942] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.118942] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.119089] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eaa0f90e-1315-418b-970b-11723b551de1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.128765] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1910b456-4028-4614-b7d7-a391136f7ea1 in Status: UNINITIALIZED for 2s [ 1037.621364] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eaa0f90e-1315-418b-970b-11723b551de1: rpc.has_security_group_logging(os_id): False [ 1037.647243] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.647243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.647243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.647243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.647243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.647243] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.647243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.647243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.647243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.647243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.647243] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.647243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.647243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.647243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.647243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.648535] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.648535] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.648535] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.648535] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.648535] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.648809] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eaa0f90e-1315-418b-970b-11723b551de1 is going to be created. [ 1037.708514] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.708666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.708740] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.709051] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.709247] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.724646] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaa0f90e-1315-418b-970b-11723b551de1 in Status: IN_PROGRESS for 2s [ 1038.227346] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e in Status: SUCCESS [ 1038.227637] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.717866] env[65322]: INFO networking_nsxv3.common.synchronization [req-211dc31f-ae37-4d78-bc3a-acd9c26d2f8d req-1eec4b6f-b3af-43ce-bf8c-5aa1518e05fb tempest-AttachInterfacesTestJSON-353803948 tempest-AttachInterfacesTestJSON-353803948-project-member] Enqueued Resource ID: 108c844e-abaf-4512-b72b-84435bbf4e4e with Priority: HIGHEST for action security_group_members [ 1038.718594] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108c844e-abaf-4512-b72b-84435bbf4e4e with Priority: HIGHEST for action security_group_members [ 1038.719171] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-108c844e-abaf-4512-b72b-84435bbf4e4e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.719335] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.719405] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.719734] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.719921] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.720065] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.720330] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.720443] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.720539] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.720951] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('108c844e-abaf-4512-b72b-84435bbf4e4e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.954204] env[65322]: INFO networking_nsxv3.common.synchronization [None req-870e6327-3ad6-4bb7-9dad-7fd2454dfbf2 None None] Enqueued Resource ID: 5aa3722c-9d2b-4224-847e-9e2fe157524e with Priority: HIGHEST for action port [ 1038.954204] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5aa3722c-9d2b-4224-847e-9e2fe157524e with Priority: HIGHEST for action port [ 1038.954204] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-5aa3722c-9d2b-4224-847e-9e2fe157524e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.954204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5aa3722c-9d2b-4224-847e-9e2fe157524e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.954204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5aa3722c-9d2b-4224-847e-9e2fe157524e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.954754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5aa3722c-9d2b-4224-847e-9e2fe157524e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.955067] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5aa3722c-9d2b-4224-847e-9e2fe157524e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.095205] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-896 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.095405] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.095524] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.095868] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.096146] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.096437] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.096437] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.096674] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.096776] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.096969] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1039.097231] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1039.097359] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1039.097467] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1039.097577] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1039.097679] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1039.097813] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1039.118703] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1039.118876] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1039.119054] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1039.119244] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.119558] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-4f33aef8-a988-4874-8531-9dce6b70d0fa taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.119722] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-4f33aef8-a988-4874-8531-9dce6b70d0fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.119839] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-4f33aef8-a988-4874-8531-9dce6b70d0fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.120260] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-4f33aef8-a988-4874-8531-9dce6b70d0fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.120393] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f33aef8-a988-4874-8531-9dce6b70d0fa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.139978] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1910b456-4028-4614-b7d7-a391136f7ea1 in Status: SUCCESS [ 1039.140244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.140706] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.140930] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.141146] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.141264] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.141329] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.141494] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.141571] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.141655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.141742] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1910b456-4028-4614-b7d7-a391136f7ea1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.223387] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.223709] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.223856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.224131] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.224221] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.224471] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.224587] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.224654] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.224870] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.224966] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.225067] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 108c844e-abaf-4512-b72b-84435bbf4e4e already deleted. [ 1039.225197] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.459794] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5aa3722c-9d2b-4224-847e-9e2fe157524e [ 1039.462030] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.462030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.462030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.462030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.462030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.462030] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5aa3722c-9d2b-4224-847e-9e2fe157524e already deleted. [ 1039.462030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5aa3722c-9d2b-4224-847e-9e2fe157524e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.622897] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.623351] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.623549] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.623945] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.624185] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.624375] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 4f33aef8-a988-4874-8531-9dce6b70d0fa not found, creating... [ 1039.624730] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.624904] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.625082] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.625345] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.625514] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.626319] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.626319] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.626319] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.626486] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.626519] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.626638] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 4f33aef8-a988-4874-8531-9dce6b70d0fa is going to be created. [ 1039.647157] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1910b456-4028-4614-b7d7-a391136f7ea1 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.647157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.647157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.647157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.647157] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.647157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.647157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.647157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.647157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.647157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.647747] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1910b456-4028-4614-b7d7-a391136f7ea1 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.647747] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.647747] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.647747] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.647747] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.647970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.647970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.648080] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.648116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.648181] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.648276] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1910b456-4028-4614-b7d7-a391136f7ea1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.654343] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.654343] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.655059] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.655273] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.655655] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.656052] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-4f33aef8-a988-4874-8531-9dce6b70d0fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.744069] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eaa0f90e-1315-418b-970b-11723b551de1 in Status: SUCCESS [ 1039.744069] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.151188] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1910b456-4028-4614-b7d7-a391136f7ea1: rpc.has_security_group_logging(os_id): False [ 1040.172315] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.172315] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.172315] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.172315] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.172315] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.172315] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.172578] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.172578] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.172641] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.172743] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.173467] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.173605] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.173664] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.173828] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.173906] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.174160] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.174418] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.174472] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.174664] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.174828] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.174933] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1910b456-4028-4614-b7d7-a391136f7ea1 is going to be created. [ 1040.267654] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.267654] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.267654] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.267654] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.267654] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.281357] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1910b456-4028-4614-b7d7-a391136f7ea1 in Status: IN_PROGRESS for 2s [ 1040.397169] env[65322]: INFO networking_nsxv3.common.synchronization [req-211dc31f-ae37-4d78-bc3a-acd9c26d2f8d req-aa9fa360-7f8e-4e68-a360-82a585d58ebd service nova] Enqueued Resource ID: 108c844e-abaf-4512-b72b-84435bbf4e4e with Priority: HIGHEST for action security_group_rules [ 1040.397169] env[65322]: INFO networking_nsxv3.common.synchronization [req-211dc31f-ae37-4d78-bc3a-acd9c26d2f8d req-aa9fa360-7f8e-4e68-a360-82a585d58ebd service nova] Enqueued Resource ID: 108c844e-abaf-4512-b72b-84435bbf4e4e with Priority: HIGHEST for action security_group_members [ 1040.397169] env[65322]: INFO networking_nsxv3.common.synchronization [req-211dc31f-ae37-4d78-bc3a-acd9c26d2f8d req-aa9fa360-7f8e-4e68-a360-82a585d58ebd service nova] Enqueued Resource ID: 4f33aef8-a988-4874-8531-9dce6b70d0fa with Priority: HIGHEST for action port [ 1040.398019] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108c844e-abaf-4512-b72b-84435bbf4e4e with Priority: HIGHEST for action security_group_rules [ 1040.398019] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108c844e-abaf-4512-b72b-84435bbf4e4e with Priority: HIGHEST for action security_group_members [ 1040.398019] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f33aef8-a988-4874-8531-9dce6b70d0fa with Priority: HIGHEST for action port [ 1040.398019] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-108c844e-abaf-4512-b72b-84435bbf4e4e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.398297] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.398297] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.398401] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.398450] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('108c844e-abaf-4512-b72b-84435bbf4e4e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.399736] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-108c844e-abaf-4512-b72b-84435bbf4e4e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.400488] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.400585] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.400781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.400989] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.401107] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.401107] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.401475] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.401475] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.401475] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('108c844e-abaf-4512-b72b-84435bbf4e4e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.402271] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f33aef8-a988-4874-8531-9dce6b70d0fa taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.402424] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f33aef8-a988-4874-8531-9dce6b70d0fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.402424] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f33aef8-a988-4874-8531-9dce6b70d0fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.402702] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f33aef8-a988-4874-8531-9dce6b70d0fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.402702] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f33aef8-a988-4874-8531-9dce6b70d0fa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.906104] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-108c844e-abaf-4512-b72b-84435bbf4e4e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.906723] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.908697] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('108c844e-abaf-4512-b72b-84435bbf4e4e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.910345] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f33aef8-a988-4874-8531-9dce6b70d0fa with status ACTIVE [ 1040.910990] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.910990] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.910990] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.910990] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.910990] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.911492] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.911492] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.911492] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.911492] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.911645] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.912595] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.912595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.912595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.912595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.912595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.912595] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f33aef8-a988-4874-8531-9dce6b70d0fa is going to be updated. [ 1040.934680] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.934680] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.934680] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.934680] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.934680] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.934928] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f33aef8-a988-4874-8531-9dce6b70d0fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.411202] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('108c844e-abaf-4512-b72b-84435bbf4e4e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.880940] env[65322]: INFO networking_nsxv3.common.synchronization [None req-022cd561-93a5-435d-983c-bc667411a10c None None] Enqueued Resource ID: 276d1ac8-c7a3-4dae-aeea-541f0e38622f with Priority: HIGHEST for action port [ 1041.881133] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 276d1ac8-c7a3-4dae-aeea-541f0e38622f with Priority: HIGHEST for action port [ 1041.881547] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-276d1ac8-c7a3-4dae-aeea-541f0e38622f taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.881663] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-276d1ac8-c7a3-4dae-aeea-541f0e38622f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.881663] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-276d1ac8-c7a3-4dae-aeea-541f0e38622f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.881901] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-276d1ac8-c7a3-4dae-aeea-541f0e38622f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.881984] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('276d1ac8-c7a3-4dae-aeea-541f0e38622f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.914251] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.914251] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.914251] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.914251] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.914683] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.914683] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 108c844e-abaf-4512-b72b-84435bbf4e4e is going to be created. [ 1041.938946] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.939296] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.939393] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.939625] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.939748] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.951231] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 108c844e-abaf-4512-b72b-84435bbf4e4e in Status: UNINITIALIZED for 2s [ 1041.983876] env[65322]: INFO networking_nsxv3.common.synchronization [req-033a4188-b872-450c-8769-ce84684ebb5b req-7e7a0c68-8592-498b-ba93-1c856bc4c484 tempest-AttachVolumeNegativeTest-885508175 tempest-AttachVolumeNegativeTest-885508175-project-member] Enqueued Resource ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 with Priority: HIGHEST for action security_group_members [ 1041.984922] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 with Priority: HIGHEST for action security_group_members [ 1041.985306] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ce3cc37-b73f-4ecb-b24a-2b06775793e8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.985432] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.985499] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.985757] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.985937] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.986054] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.986129] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.986296] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.986377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.986961] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ce3cc37-b73f-4ecb-b24a-2b06775793e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.298527] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1910b456-4028-4614-b7d7-a391136f7ea1 in Status: SUCCESS [ 1042.298753] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.384727] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 276d1ac8-c7a3-4dae-aeea-541f0e38622f [ 1042.384727] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.385102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.385102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.385729] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.385729] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.385729] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:276d1ac8-c7a3-4dae-aeea-541f0e38622f already deleted. [ 1042.385729] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-276d1ac8-c7a3-4dae-aeea-541f0e38622f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.483895] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-318 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.484191] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-318" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.484277] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-318" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.484583] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-318" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.484879] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.485074] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.485191] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.485422] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.485565] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.485793] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1042.485879] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1042.486041] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1042.486109] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1042.486224] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1042.486324] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1042.486458] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1042.488466] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.488596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.488662] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.488824] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.488913] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.489103] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.489233] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.489287] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.489398] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.489477] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.489550] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 already deleted. [ 1042.489631] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.510800] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1042.511047] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1042.511159] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1042.511280] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-318" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.511672] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-05b527d2-9f78-4cd2-8b66-1c6597471615 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.511880] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-05b527d2-9f78-4cd2-8b66-1c6597471615" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.512057] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-05b527d2-9f78-4cd2-8b66-1c6597471615" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.512755] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-05b527d2-9f78-4cd2-8b66-1c6597471615" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.513922] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05b527d2-9f78-4cd2-8b66-1c6597471615',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.020583] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.020906] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.020982] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.021751] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.021751] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.021751] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 05b527d2-9f78-4cd2-8b66-1c6597471615 not found, creating... [ 1043.021936] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.022022] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.022593] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.022973] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.023206] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.024402] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.024643] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.024796] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.025152] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.025328] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.025500] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 05b527d2-9f78-4cd2-8b66-1c6597471615 is going to be created. [ 1043.048381] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.048610] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.048700] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.048985] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.049228] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.049446] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-05b527d2-9f78-4cd2-8b66-1c6597471615" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.821186] env[65322]: INFO networking_nsxv3.common.synchronization [req-033a4188-b872-450c-8769-ce84684ebb5b req-304e0b19-f4fe-41fa-af60-f000b39548b3 service nova] Enqueued Resource ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 with Priority: HIGHEST for action security_group_rules [ 1043.821410] env[65322]: INFO networking_nsxv3.common.synchronization [req-033a4188-b872-450c-8769-ce84684ebb5b req-304e0b19-f4fe-41fa-af60-f000b39548b3 service nova] Enqueued Resource ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 with Priority: HIGHEST for action security_group_members [ 1043.821615] env[65322]: INFO networking_nsxv3.common.synchronization [req-033a4188-b872-450c-8769-ce84684ebb5b req-304e0b19-f4fe-41fa-af60-f000b39548b3 service nova] Enqueued Resource ID: 05b527d2-9f78-4cd2-8b66-1c6597471615 with Priority: HIGHEST for action port [ 1043.822303] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 with Priority: HIGHEST for action security_group_rules [ 1043.822415] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 with Priority: HIGHEST for action security_group_members [ 1043.822477] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05b527d2-9f78-4cd2-8b66-1c6597471615 with Priority: HIGHEST for action port [ 1043.822764] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ce3cc37-b73f-4ecb-b24a-2b06775793e8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.822973] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.822973] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.823263] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.823383] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ce3cc37-b73f-4ecb-b24a-2b06775793e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.824256] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ce3cc37-b73f-4ecb-b24a-2b06775793e8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.824368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.824433] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.824638] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.825213] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.825213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.825213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.825213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.825458] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.825458] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ce3cc37-b73f-4ecb-b24a-2b06775793e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.832469] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-05b527d2-9f78-4cd2-8b66-1c6597471615 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.832469] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05b527d2-9f78-4cd2-8b66-1c6597471615" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.832469] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05b527d2-9f78-4cd2-8b66-1c6597471615" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.832469] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05b527d2-9f78-4cd2-8b66-1c6597471615" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.832469] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05b527d2-9f78-4cd2-8b66-1c6597471615',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.939667] env[65322]: INFO networking_nsxv3.common.synchronization [req-d64b7e49-48a2-442b-a3fc-14bbc81b941d req-ee570b00-5380-42c7-9e02-cad3f8b7bce8 tempest-DeleteServersAdminTestJSON-810815226 tempest-DeleteServersAdminTestJSON-810815226-project-member] Enqueued Resource ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e with Priority: HIGHEST for action security_group_members [ 1043.940345] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e with Priority: HIGHEST for action security_group_members [ 1043.941073] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.941205] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.941317] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.941691] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.941887] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.942582] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.942582] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.942582] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.942582] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.942582] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fc4077b8-3a0e-4709-8542-93ed5e2bc81e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.961582] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 108c844e-abaf-4512-b72b-84435bbf4e4e in Status: SUCCESS [ 1043.961802] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.962794] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.963098] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.963359] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.963463] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.963537] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.963715] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.963800] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.963888] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.964037] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('108c844e-abaf-4512-b72b-84435bbf4e4e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.334025] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ce3cc37-b73f-4ecb-b24a-2b06775793e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.335446] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ce3cc37-b73f-4ecb-b24a-2b06775793e8 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.335446] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.335610] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05b527d2-9f78-4cd2-8b66-1c6597471615 with status ACTIVE [ 1044.335703] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.338081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.338081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.338081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.338081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.338081] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.338081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.338081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.338081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.338081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.338081] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.338081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.338081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.338081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.338081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.338871] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05b527d2-9f78-4cd2-8b66-1c6597471615 is going to be updated. [ 1044.364519] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.364519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.364519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.365022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.365022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.365148] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05b527d2-9f78-4cd2-8b66-1c6597471615" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.447863] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.447863] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.447863] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.447863] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.447863] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.447863] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.447863] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.447863] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.447863] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.447863] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.447863] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e is going to be updated. [ 1044.467064] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('108c844e-abaf-4512-b72b-84435bbf4e4e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.508741] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.508741] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.508741] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.508741] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.509180] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.524492] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e in Status: IN_PROGRESS for 2s [ 1044.710785] env[65322]: INFO networking_nsxv3.common.synchronization [req-59704489-fb5f-437d-a72f-04af0267317c req-1558955b-395b-4e8e-af36-518fd3830e4e tempest-ServerActionsTestJSON-71326710 tempest-ServerActionsTestJSON-71326710-project-member] Enqueued Resource ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 with Priority: HIGHEST for action security_group_members [ 1044.711379] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 with Priority: HIGHEST for action security_group_members [ 1044.711700] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.711833] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.711880] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.712489] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.712661] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.712849] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.712983] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.713137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.713137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.713305] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.840792] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ce3cc37-b73f-4ecb-b24a-2b06775793e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.972019] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 108c844e-abaf-4512-b72b-84435bbf4e4e: rpc.has_security_group_logging(os_id): False [ 1044.992339] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.992588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.992659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.992995] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.993233] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.993472] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.993606] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.993674] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.994784] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.994784] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.994784] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 108c844e-abaf-4512-b72b-84435bbf4e4e is going to be created. [ 1045.061610] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.061610] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.061749] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.062755] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.062755] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.073807] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-710 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.073938] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.073986] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.074263] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.074526] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.074683] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.074794] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.075052] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.075240] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.075507] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1045.075566] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1045.075669] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1045.075814] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1045.075887] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1045.075991] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1045.076160] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1045.077839] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 108c844e-abaf-4512-b72b-84435bbf4e4e in Status: IN_PROGRESS for 2s [ 1045.102984] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1045.102984] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1045.102984] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1045.102984] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.102984] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-15962387-fdc2-442e-9cd3-2f3f260f9cb4 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.102984] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-15962387-fdc2-442e-9cd3-2f3f260f9cb4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.102984] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-15962387-fdc2-442e-9cd3-2f3f260f9cb4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.102984] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-15962387-fdc2-442e-9cd3-2f3f260f9cb4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.103448] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15962387-fdc2-442e-9cd3-2f3f260f9cb4',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.217232] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.217502] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.217606] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.220832] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.220832] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.220832] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.220832] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.220832] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.220832] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.220832] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.220832] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 already deleted. [ 1045.220832] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.343157] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.343493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.343493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.343711] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.343711] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.344767] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 is going to be created. [ 1045.367242] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.367447] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.367447] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.367648] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.367793] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.378606] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 in Status: UNINITIALIZED for 2s [ 1045.606384] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.606384] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.606384] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.606384] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.606384] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.606384] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 15962387-fdc2-442e-9cd3-2f3f260f9cb4 not found, creating... [ 1045.606783] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.606842] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.606948] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.607310] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.607517] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.607914] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.608137] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.608303] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.608592] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.608787] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.608946] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 15962387-fdc2-442e-9cd3-2f3f260f9cb4 is going to be created. [ 1045.632819] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.633035] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.633174] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.633449] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.633677] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.633893] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-15962387-fdc2-442e-9cd3-2f3f260f9cb4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.308061] env[65322]: INFO networking_nsxv3.common.synchronization [req-71383b48-14ae-400d-be02-10fa4b4c2f27 req-a3bdb6b5-0070-4b4a-a1f8-ef801c489d54 tempest-ServerRescueNegativeTestJSON-325476461 tempest-ServerRescueNegativeTestJSON-325476461-project-member] Enqueued Resource ID: 429d42d7-e5e7-4ade-9c7f-c5151648e98f with Priority: HIGHEST for action security_group_members [ 1046.308659] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 429d42d7-e5e7-4ade-9c7f-c5151648e98f with Priority: HIGHEST for action security_group_members [ 1046.308964] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-429d42d7-e5e7-4ade-9c7f-c5151648e98f taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.309101] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.309170] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.309374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.309644] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.309644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.309777] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.309815] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.309901] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.309993] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('429d42d7-e5e7-4ade-9c7f-c5151648e98f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.406935] env[65322]: INFO networking_nsxv3.common.synchronization [req-59704489-fb5f-437d-a72f-04af0267317c req-e4bfda3d-d447-4efb-b078-a7f5c0cc842a service nova] Enqueued Resource ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 with Priority: HIGHEST for action security_group_rules [ 1046.407318] env[65322]: INFO networking_nsxv3.common.synchronization [req-59704489-fb5f-437d-a72f-04af0267317c req-e4bfda3d-d447-4efb-b078-a7f5c0cc842a service nova] Enqueued Resource ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 with Priority: HIGHEST for action security_group_members [ 1046.407318] env[65322]: INFO networking_nsxv3.common.synchronization [req-59704489-fb5f-437d-a72f-04af0267317c req-e4bfda3d-d447-4efb-b078-a7f5c0cc842a service nova] Enqueued Resource ID: 15962387-fdc2-442e-9cd3-2f3f260f9cb4 with Priority: HIGHEST for action port [ 1046.408865] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 with Priority: HIGHEST for action security_group_rules [ 1046.409045] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 with Priority: HIGHEST for action security_group_members [ 1046.409116] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15962387-fdc2-442e-9cd3-2f3f260f9cb4 with Priority: HIGHEST for action port [ 1046.409571] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.409693] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.409755] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.410044] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.410044] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.410782] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.411053] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.411053] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.411154] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.411284] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.411372] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.411430] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.411561] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.411648] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.411737] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.412488] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-15962387-fdc2-442e-9cd3-2f3f260f9cb4 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.412598] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15962387-fdc2-442e-9cd3-2f3f260f9cb4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.412700] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15962387-fdc2-442e-9cd3-2f3f260f9cb4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.412801] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15962387-fdc2-442e-9cd3-2f3f260f9cb4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.412890] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15962387-fdc2-442e-9cd3-2f3f260f9cb4',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.537347] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e in Status: SUCCESS [ 1046.537654] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e deletion is rescheduled due to dependency. [ 1046.537843] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.812035] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.812212] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.812212] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.812389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.812479] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.812686] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.812808] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.813068] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.813238] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.813320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.813411] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 429d42d7-e5e7-4ade-9c7f-c5151648e98f is going to be updated. [ 1046.843909] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.846298] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.846440] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.846622] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.846769] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.858590] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 429d42d7-e5e7-4ade-9c7f-c5151648e98f in Status: IN_PROGRESS for 2s [ 1046.915160] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.915292] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.915455] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.918568] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 15962387-fdc2-442e-9cd3-2f3f260f9cb4 with status ACTIVE [ 1046.918616] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.918716] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.920359] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.920359] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.920359] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.920359] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.920359] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.920359] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.920359] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.920359] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.920359] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.920359] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.920359] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.920359] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.920359] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.920359] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 15962387-fdc2-442e-9cd3-2f3f260f9cb4 is going to be updated. [ 1046.941949] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.941949] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.941949] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.941949] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.941949] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.941949] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15962387-fdc2-442e-9cd3-2f3f260f9cb4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.097120] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 108c844e-abaf-4512-b72b-84435bbf4e4e in Status: SUCCESS [ 1047.097120] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.214374] env[65322]: INFO networking_nsxv3.common.synchronization [req-6c7d839a-c9c3-4b11-b064-75e3a0466b00 req-eb1a3b82-3216-42fe-b4e8-852ac5939e4e tempest-AttachVolumeTestJSON-1389790413 tempest-AttachVolumeTestJSON-1389790413-project-member] Enqueued Resource ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 with Priority: HIGHEST for action security_group_members [ 1047.215753] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 with Priority: HIGHEST for action security_group_members [ 1047.215753] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6d8499f-80cb-4c22-b03a-011aac96ea05 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.215753] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.215753] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.216027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.216027] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.216123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.216123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.216420] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.216420] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.216521] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6d8499f-80cb-4c22-b03a-011aac96ea05',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.392598] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 in Status: SUCCESS [ 1047.392598] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.392598] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.392598] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.392598] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.392598] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.392598] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.392598] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.392598] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.392598] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.393131] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5ce3cc37-b73f-4ecb-b24a-2b06775793e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.418976] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.646807] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-517 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.647059] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-517" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.647217] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-517" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.647551] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-517" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.647766] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.647919] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.648372] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.648711] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.648972] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.649444] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1047.649637] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1047.649791] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1047.649955] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1047.650136] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1047.650296] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1047.650773] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1047.671987] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1047.672232] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1047.672400] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1047.672705] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-517" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.673137] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-2b363d62-2c70-46b4-a76f-17a259a92979 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.673401] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-2b363d62-2c70-46b4-a76f-17a259a92979" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.673614] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-2b363d62-2c70-46b4-a76f-17a259a92979" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.673960] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-2b363d62-2c70-46b4-a76f-17a259a92979" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.674190] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b363d62-2c70-46b4-a76f-17a259a92979',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.720502] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.720705] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.720807] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.720978] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.721098] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.721311] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.721420] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.721522] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.721724] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.721803] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.721895] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 is going to be updated. [ 1047.755343] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.755624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.755624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.755741] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.755893] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.775022] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 in Status: IN_PROGRESS for 2s [ 1047.898820] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5ce3cc37-b73f-4ecb-b24a-2b06775793e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.923592] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.923592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.923592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.923592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.923592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.923592] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 is going to be created. [ 1047.955949] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.955949] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.955949] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.955949] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.955949] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.965933] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 in Status: UNINITIALIZED for 2s [ 1048.178162] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.178162] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.178162] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.178162] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.178162] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.178395] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.178545] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.178660] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.178883] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.179057] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.179310] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.179463] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.179575] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.179780] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.179911] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.180064] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 2b363d62-2c70-46b4-a76f-17a259a92979 is going to be updated. [ 1048.202405] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.202684] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.202855] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.203225] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.203511] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.203789] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-2b363d62-2c70-46b4-a76f-17a259a92979" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.334504] env[65322]: INFO networking_nsxv3.common.synchronization [req-6307261e-300c-47f2-8da2-15b4a6edb983 req-4a8161e2-d0a7-4178-b272-54a4c7fc6e32 tempest-AttachVolumeShelveTestJSON-315803451 tempest-AttachVolumeShelveTestJSON-315803451-project-member] Enqueued Resource ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 with Priority: HIGHEST for action security_group_members [ 1048.334995] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 with Priority: HIGHEST for action security_group_members [ 1048.335322] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbf21d11-c10d-47fc-811b-f6af5267a9d6 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.335447] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.335511] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.335719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.335875] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.336033] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.336118] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.336323] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.336480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.336548] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbf21d11-c10d-47fc-811b-f6af5267a9d6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.403913] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5ce3cc37-b73f-4ecb-b24a-2b06775793e8: rpc.has_security_group_logging(os_id): False [ 1048.425657] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.426956] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.426956] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.426956] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.426956] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.427155] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.427155] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.427244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.427356] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.427410] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.427498] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 is going to be created. [ 1048.497188] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.497501] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.497501] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.497598] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.497984] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.509625] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 in Status: IN_PROGRESS for 2s [ 1048.838544] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.838733] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.838776] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.839046] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.839387] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.839387] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.839473] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.839516] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.839723] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.839723] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.839842] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 is going to be updated. [ 1048.868071] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 429d42d7-e5e7-4ade-9c7f-c5151648e98f in Status: SUCCESS [ 1048.868250] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 429d42d7-e5e7-4ade-9c7f-c5151648e98f deletion is rescheduled due to dependency. [ 1048.868309] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-429d42d7-e5e7-4ade-9c7f-c5151648e98f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.874787] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.874975] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.875059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.875274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.875447] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.885427] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 in Status: IN_PROGRESS for 2s [ 1048.919550] env[65322]: INFO networking_nsxv3.common.synchronization [req-a356d2d2-701f-4703-9142-d39d18dddd17 req-c1cd52a0-56b0-4a28-8a6c-a2af661ebcde service nova] Enqueued Resource ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 with Priority: HIGHEST for action security_group_rules [ 1048.919734] env[65322]: INFO networking_nsxv3.common.synchronization [req-a356d2d2-701f-4703-9142-d39d18dddd17 req-c1cd52a0-56b0-4a28-8a6c-a2af661ebcde service nova] Enqueued Resource ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 with Priority: HIGHEST for action security_group_members [ 1048.919852] env[65322]: INFO networking_nsxv3.common.synchronization [req-a356d2d2-701f-4703-9142-d39d18dddd17 req-c1cd52a0-56b0-4a28-8a6c-a2af661ebcde service nova] Enqueued Resource ID: 2b363d62-2c70-46b4-a76f-17a259a92979 with Priority: HIGHEST for action port [ 1048.920365] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 with Priority: HIGHEST for action security_group_rules [ 1048.920502] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 with Priority: HIGHEST for action security_group_members [ 1048.920599] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b363d62-2c70-46b4-a76f-17a259a92979 with Priority: HIGHEST for action port [ 1048.920894] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d8cdb67-7719-40d5-8ef7-63d3e76937f0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.921018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.921869] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.922505] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.922587] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.924033] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.924510] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.924510] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.924510] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.924672] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.925283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.925283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.925283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.925283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.925283] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.926298] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b363d62-2c70-46b4-a76f-17a259a92979 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.926298] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b363d62-2c70-46b4-a76f-17a259a92979" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.926298] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b363d62-2c70-46b4-a76f-17a259a92979" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.926476] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b363d62-2c70-46b4-a76f-17a259a92979" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.926513] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b363d62-2c70-46b4-a76f-17a259a92979',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.428771] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.429853] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.429969] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.430237] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b363d62-2c70-46b4-a76f-17a259a92979 with status ACTIVE [ 1049.430320] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.430422] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.430502] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.431192] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.431192] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.431192] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.431192] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.431192] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.431424] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.431424] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.431591] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.431673] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.431728] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.431839] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.431914] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.431999] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b363d62-2c70-46b4-a76f-17a259a92979 is going to be updated. [ 1049.457161] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.457407] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.457407] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.457519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.457662] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.457825] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b363d62-2c70-46b4-a76f-17a259a92979" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.787102] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 in Status: SUCCESS [ 1049.787651] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 deletion is rescheduled due to dependency. [ 1049.787651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.936199] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.977567] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 in Status: SUCCESS [ 1049.977567] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.977567] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.978060] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.978060] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.978060] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.978201] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.978508] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.978605] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.978696] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.978787] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.267018] env[65322]: INFO networking_nsxv3.common.synchronization [req-533c246f-a116-4f8d-aaa8-5d95d23df868 req-b834b62a-8e2d-4d5c-82d8-f26d988ee7a0 tempest-ImagesOneServerTestJSON-1587877163 tempest-ImagesOneServerTestJSON-1587877163-project-member] Enqueued Resource ID: 13d294c9-5967-4aff-b987-840ca5e2ead4 with Priority: HIGHEST for action security_group_members [ 1050.267018] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13d294c9-5967-4aff-b987-840ca5e2ead4 with Priority: HIGHEST for action security_group_members [ 1050.267018] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-13d294c9-5967-4aff-b987-840ca5e2ead4 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.267018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.267018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.267018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.267309] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.267309] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.267397] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.267633] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.267674] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.267743] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13d294c9-5967-4aff-b987-840ca5e2ead4',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.438516] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.438868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.438868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.439736] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.439736] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.439736] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 is going to be updated. [ 1050.480862] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.481078] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.481151] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.481451] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.481655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.483930] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.495137] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 in Status: IN_PROGRESS for 2s [ 1050.545593] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 in Status: SUCCESS [ 1050.545887] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.771867] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.771867] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.771867] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.771867] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.771867] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.772206] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.772631] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.772631] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.772745] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.772857] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.772967] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13d294c9-5967-4aff-b987-840ca5e2ead4 already deleted. [ 1050.773067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.841667] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-421 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.841939] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-421" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.842021] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-421" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.842459] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-421" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.842761] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.842932] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.843228] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.843473] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.843627] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.844254] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1050.844254] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1050.844254] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1050.844437] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1050.844437] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1050.844572] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1050.844695] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1050.880956] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1050.881344] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1050.881773] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1050.882035] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-421" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.882647] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-13e7e2de-af13-4c61-b8c7-6425a61e6b95 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.882960] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-13e7e2de-af13-4c61-b8c7-6425a61e6b95" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.883154] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-13e7e2de-af13-4c61-b8c7-6425a61e6b95" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.883565] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-13e7e2de-af13-4c61-b8c7-6425a61e6b95" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.883736] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13e7e2de-af13-4c61-b8c7-6425a61e6b95',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.905154] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 in Status: SUCCESS [ 1050.905402] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbf21d11-c10d-47fc-811b-f6af5267a9d6 deletion is rescheduled due to dependency. [ 1050.905402] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbf21d11-c10d-47fc-811b-f6af5267a9d6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.986228] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90: rpc.has_security_group_logging(os_id): False [ 1051.009323] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.009953] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.009953] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.009953] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.009953] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.010283] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.010458] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.010458] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.010644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.010728] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.010820] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 is going to be created. [ 1051.087367] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.087581] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.087642] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.087894] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.088120] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.103442] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 in Status: IN_PROGRESS for 2s [ 1051.387558] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.388561] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.388561] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.388561] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.388561] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.388855] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 13e7e2de-af13-4c61-b8c7-6425a61e6b95 not found, creating... [ 1051.388918] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.389509] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.389509] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.389509] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.389757] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.389867] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.391488] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.391488] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.391488] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.391488] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.391488] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 13e7e2de-af13-4c61-b8c7-6425a61e6b95 is going to be created. [ 1051.411431] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.411676] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.411781] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.412279] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.412513] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.412755] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-13e7e2de-af13-4c61-b8c7-6425a61e6b95" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.136845] env[65322]: INFO networking_nsxv3.common.synchronization [req-533c246f-a116-4f8d-aaa8-5d95d23df868 req-ce73130e-1d94-4ab0-8e61-53d3619486b8 service nova] Enqueued Resource ID: 13d294c9-5967-4aff-b987-840ca5e2ead4 with Priority: HIGHEST for action security_group_rules [ 1052.137174] env[65322]: INFO networking_nsxv3.common.synchronization [req-533c246f-a116-4f8d-aaa8-5d95d23df868 req-ce73130e-1d94-4ab0-8e61-53d3619486b8 service nova] Enqueued Resource ID: 13d294c9-5967-4aff-b987-840ca5e2ead4 with Priority: HIGHEST for action security_group_members [ 1052.137219] env[65322]: INFO networking_nsxv3.common.synchronization [req-533c246f-a116-4f8d-aaa8-5d95d23df868 req-ce73130e-1d94-4ab0-8e61-53d3619486b8 service nova] Enqueued Resource ID: 13e7e2de-af13-4c61-b8c7-6425a61e6b95 with Priority: HIGHEST for action port [ 1052.137469] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13d294c9-5967-4aff-b987-840ca5e2ead4 with Priority: HIGHEST for action security_group_rules [ 1052.137601] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13d294c9-5967-4aff-b987-840ca5e2ead4 with Priority: HIGHEST for action security_group_members [ 1052.137856] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13e7e2de-af13-4c61-b8c7-6425a61e6b95 with Priority: HIGHEST for action port [ 1052.138409] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-13d294c9-5967-4aff-b987-840ca5e2ead4 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.138556] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.138669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.138912] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.138991] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('13d294c9-5967-4aff-b987-840ca5e2ead4',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.140895] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-13d294c9-5967-4aff-b987-840ca5e2ead4 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.141029] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.141105] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.141296] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.141456] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.141565] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.141623] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.141792] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.141845] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.141936] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13d294c9-5967-4aff-b987-840ca5e2ead4',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.142900] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-13e7e2de-af13-4c61-b8c7-6425a61e6b95 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.143055] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13e7e2de-af13-4c61-b8c7-6425a61e6b95" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.143100] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13e7e2de-af13-4c61-b8c7-6425a61e6b95" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.143262] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13e7e2de-af13-4c61-b8c7-6425a61e6b95" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.143356] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13e7e2de-af13-4c61-b8c7-6425a61e6b95',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.362218] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.362477] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.363023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.363509] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.363732] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.509569] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 in Status: SUCCESS [ 1052.509872] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.510111] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.510406] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.510675] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.510833] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.510887] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.511082] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.511170] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.511284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.511338] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.588383] env[65322]: INFO networking_nsxv3.common.synchronization [req-2d9e615d-9906-4356-b517-5a49ba87976c req-51b38c91-9973-420e-b708-fbd63290ee86 tempest-ServerAddressesTestJSON-611118058 tempest-ServerAddressesTestJSON-611118058-project-member] Enqueued Resource ID: 1910b456-4028-4614-b7d7-a391136f7ea1 with Priority: HIGHEST for action security_group_members [ 1052.589184] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1910b456-4028-4614-b7d7-a391136f7ea1 with Priority: HIGHEST for action security_group_members [ 1052.590087] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1910b456-4028-4614-b7d7-a391136f7ea1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.590396] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.590628] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.591032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.591395] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.591651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.591804] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.592087] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.592277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.592460] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1910b456-4028-4614-b7d7-a391136f7ea1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.645370] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-13d294c9-5967-4aff-b987-840ca5e2ead4 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.645659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.645659] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 13e7e2de-af13-4c61-b8c7-6425a61e6b95 with status ACTIVE [ 1052.645875] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.645975] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.645975] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.646256] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.646354] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.646548] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.646646] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.646707] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.646867] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.646944] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.647134] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.647236] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.647296] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.647443] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.647514] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.647597] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 13e7e2de-af13-4c61-b8c7-6425a61e6b95 is going to be updated. [ 1052.649175] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('13d294c9-5967-4aff-b987-840ca5e2ead4',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.682662] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.682853] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.682853] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.683101] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.683241] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.683451] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13e7e2de-af13-4c61-b8c7-6425a61e6b95" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.866931] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.013837] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.014047] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.014204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.014360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.014567] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.014714] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.014816] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.015313] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.015313] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.015313] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.015484] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.015484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.015484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.015655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.015940] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.015940] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.015940] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.016071] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.016124] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.016328] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.016328] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.094918] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.095861] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.095861] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.095861] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.095861] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.096048] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.096048] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.096151] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.096271] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.096347] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.096434] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1910b456-4028-4614-b7d7-a391136f7ea1 is going to be updated. [ 1053.117947] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 in Status: SUCCESS [ 1053.118371] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.129968] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.130217] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.130327] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.130630] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.130844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.142889] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1910b456-4028-4614-b7d7-a391136f7ea1 in Status: IN_PROGRESS for 2s [ 1053.152357] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('13d294c9-5967-4aff-b987-840ca5e2ead4',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.370401] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.519326] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d8cdb67-7719-40d5-8ef7-63d3e76937f0: rpc.has_security_group_logging(os_id): False [ 1053.540242] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.540383] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.540448] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.540665] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.540756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.540944] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.541055] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.541123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.541271] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.541344] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.541535] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.541629] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.541691] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.541830] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.541902] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.542156] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.542282] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.542282] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.543057] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.543057] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.543057] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 is going to be updated. [ 1053.611035] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.611303] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.611303] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.611603] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.611842] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.627994] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 in Status: IN_PROGRESS for 2s [ 1053.655117] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.655379] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.655379] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.656812] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.656812] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.656812] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13d294c9-5967-4aff-b987-840ca5e2ead4 is going to be created. [ 1053.692401] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.692401] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.692401] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.692401] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.692401] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.704073] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13d294c9-5967-4aff-b987-840ca5e2ead4 in Status: UNINITIALIZED for 2s [ 1053.872833] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1053.872965] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1054.814034] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.814034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.814034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.814422] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.828940] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1054.830771] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.832089] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1054.870577] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.870782] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.870871] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.872050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.883157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.884184] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1054.884415] env[65322]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65322) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1054.884415] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1054.934233] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.934538] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.934538] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.934746] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.936466] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.936687] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1055.059771] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.060019] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.060140] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.060431] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.060884] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.061224] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1055.157016] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1910b456-4028-4614-b7d7-a391136f7ea1 in Status: SUCCESS [ 1055.157462] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1910b456-4028-4614-b7d7-a391136f7ea1 deletion is rescheduled due to dependency. [ 1055.157462] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1910b456-4028-4614-b7d7-a391136f7ea1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.163460] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.163460] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.163460] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.163460] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.163786] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.164239] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1055.164239] env[65322]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'ef78971b-78bd-41bb-9a08-bdae7a3b226a', 'a34cfbc5-e3ce-4943-8058-702a82703915', 'e2419cbe-07eb-4d04-a37e-18623c658710', '4eae2009-1124-44b2-a496-3582997767b0', 'fc4077b8-3a0e-4709-8542-93ed5e2bc81e', '26df6822-523e-4c95-9d74-db0cddb065c0', '7bf5edc0-c1b5-489c-9093-35e6cf4bd266', '5ce3cc37-b73f-4ecb-b24a-2b06775793e8', '3a07e97d-006e-4334-801f-7251980b19f1', '1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d', 'd6d8499f-80cb-4c22-b03a-011aac96ea05', '9697a5d8-1fb8-45ef-a30e-a1b99942e3e8', '42a0bf4e-f927-429d-910f-f0fec4b5f3c8', '3ed63561-0704-4a50-8dc8-a078d5c0c6f3', '2d8cdb67-7719-40d5-8ef7-63d3e76937f0', 'd1550bb0-c88b-4864-824e-b80ca3b52834', '7e65996f-05e7-4178-bdb9-30270bc56380', '60b11f04-8768-43f5-bcb0-8bb51ec0bdf2', '83773a1e-a41f-4b44-9df1-b3c8d1937490', 'e863a544-814a-4bca-b4b1-35f9a61afcd3', '9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90', 'dae95ed3-e249-4093-bc1a-6e3471cc5953', '06de8ea8-08fd-4206-a96b-fafa1c856867', 'eaa0f90e-1315-418b-970b-11723b551de1', 'c552e7e9-dc55-4efc-afb8-91a443d0679a', '506e677b-3a46-4740-8e93-f6dcf6d18933', '108c844e-abaf-4512-b72b-84435bbf4e4e', '0300d669-cfda-4a93-9701-2092bc2115c1', '260ad733-0f5d-43fb-be04-c8ecbbbcea08', 'e4dca03f-65fb-4951-910c-8904302d70fa', '1910b456-4028-4614-b7d7-a391136f7ea1', '16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16', '7f4b8024-2bac-4f34-a6d3-9d32d83408c9', 'aa7cb676-7b51-4e93-980a-5540e7a7e88b', '8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd', '429d42d7-e5e7-4ade-9c7f-c5151648e98f', '739eb2bf-8f60-406e-b099-1671d90b8545', 'f71805db-9045-455c-ad23-3895d2f4e721', 'bde2ba93-08d3-4359-9ce7-0ff97de68964', '1d03ae1b-566c-4270-87f0-fce3e636d072', '51992ebb-4768-42b5-9c53-db9beef2ee89', 'fbf21d11-c10d-47fc-811b-f6af5267a9d6', 'b43d5c58-0cb4-4f14-b009-7fe58147ee41', '694536fa-8e1e-4cf0-9017-118a0337a180', '67117db1-586f-43f8-920a-dd7b8767d9ec', '08f780ea-bce2-462d-b3b7-63ec1260a6bb'} {{(pid=65322) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1055.164239] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1055.188305] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.188531] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.188531] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.188756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.188848] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.188957] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1055.189056] env[65322]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65322) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1055.189134] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1055.265224] env[65322]: INFO networking_nsxv3.common.synchronization [None req-efc99313-7014-420a-8720-469ef4b43ba9 None None] Enqueued Resource ID: 88dd15a6-baba-42bd-866e-1f374207d416 with Priority: HIGHEST for action port [ 1055.265552] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88dd15a6-baba-42bd-866e-1f374207d416 with Priority: HIGHEST for action port [ 1055.266214] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-88dd15a6-baba-42bd-866e-1f374207d416 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.266214] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88dd15a6-baba-42bd-866e-1f374207d416" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.266419] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88dd15a6-baba-42bd-866e-1f374207d416" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.266777] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88dd15a6-baba-42bd-866e-1f374207d416" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.266777] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88dd15a6-baba-42bd-866e-1f374207d416',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.288018] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.288183] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.288320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.288459] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.289536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.289817] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1055.289897] env[65322]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65322) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1055.289959] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1055.290038] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1055.290112] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1055.290209] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGH for action security_group_rules [ 1055.290263] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGH for action security_group_rules [ 1055.290324] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e2419cbe-07eb-4d04-a37e-18623c658710 with Priority: HIGH for action security_group_rules [ 1055.290382] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGH for action security_group_rules [ 1055.290436] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e with Priority: HIGH for action security_group_rules [ 1055.290496] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 26df6822-523e-4c95-9d74-db0cddb065c0 with Priority: HIGH for action security_group_rules [ 1055.290557] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 with Priority: HIGH for action security_group_rules [ 1055.290618] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 with Priority: HIGH for action security_group_rules [ 1055.290672] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGH for action security_group_rules [ 1055.290733] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGH for action security_group_rules [ 1055.290803] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 with Priority: HIGH for action security_group_rules [ 1055.290856] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 with Priority: HIGH for action security_group_rules [ 1055.290901] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 with Priority: HIGH for action security_group_rules [ 1055.290948] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGH for action security_group_rules [ 1055.291013] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 with Priority: HIGH for action security_group_rules [ 1055.291070] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGH for action security_group_rules [ 1055.291132] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGH for action security_group_rules [ 1055.291193] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 with Priority: HIGH for action security_group_rules [ 1055.291254] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 83773a1e-a41f-4b44-9df1-b3c8d1937490 with Priority: HIGH for action security_group_rules [ 1055.291350] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGH for action security_group_rules [ 1055.291416] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.621957] env[65322]: INFO networking_nsxv3.common.synchronization [req-30641f00-9e18-44b3-9ca0-d3134153e90e req-e14a722b-9efe-42e0-b7e7-9044936ba662 tempest-ServersAdminTestJSON-1989503110 tempest-ServersAdminTestJSON-1989503110-project-member] Enqueued Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_members [ 1055.622671] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGHEST for action security_group_members [ 1055.623087] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a with Priority: HIGH for action security_group_rules [ 1055.623361] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2419cbe-07eb-4d04-a37e-18623c658710 with Priority: HIGH for action security_group_rules [ 1055.623576] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 with Priority: HIGH for action security_group_rules [ 1055.623769] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 with Priority: HIGH for action security_group_rules [ 1055.623962] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGH for action security_group_rules [ 1055.624160] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83773a1e-a41f-4b44-9df1-b3c8d1937490 with Priority: HIGH for action security_group_rules [ 1055.624335] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 with Priority: HIGH for action security_group_rules [ 1055.624524] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e65996f-05e7-4178-bdb9-30270bc56380 with Priority: HIGH for action security_group_rules [ 1055.624759] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 with Priority: HIGH for action security_group_rules [ 1055.624956] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1550bb0-c88b-4864-824e-b80ca3b52834 with Priority: HIGH for action security_group_rules [ 1055.625200] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 with Priority: HIGH for action security_group_rules [ 1055.625757] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 with Priority: HIGH for action security_group_rules [ 1055.626100] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 with Priority: HIGH for action security_group_rules [ 1055.626314] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGH for action security_group_rules [ 1055.626507] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a07e97d-006e-4334-801f-7251980b19f1 with Priority: HIGH for action security_group_rules [ 1055.626704] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26df6822-523e-4c95-9d74-db0cddb065c0 with Priority: HIGH for action security_group_rules [ 1055.626897] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 with Priority: HIGH for action security_group_rules [ 1055.627332] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e with Priority: HIGH for action security_group_rules [ 1055.629023] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGH for action security_group_rules [ 1055.629023] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eae2009-1124-44b2-a496-3582997767b0 with Priority: HIGH for action security_group_rules [ 1055.629023] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.629023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.629023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.629023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.629023] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.629023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.629023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.629023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.629023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.629023] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.631162] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ef78971b-78bd-41bb-9a08-bdae7a3b226a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.633090] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.633090] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.633090] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.633090] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ef78971b-78bd-41bb-9a08-bdae7a3b226a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.633882] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e2419cbe-07eb-4d04-a37e-18623c658710 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.634136] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.634286] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.634641] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.634882] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e2419cbe-07eb-4d04-a37e-18623c658710',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.639123] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bf5edc0-c1b5-489c-9093-35e6cf4bd266 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.639123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.639123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.639123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.639123] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bf5edc0-c1b5-489c-9093-35e6cf4bd266',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.639123] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d8cdb67-7719-40d5-8ef7-63d3e76937f0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.639123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.639123] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.639123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.639935] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.640158] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.640279] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.641062] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-83773a1e-a41f-4b44-9df1-b3c8d1937490 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.641160] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.641220] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.641383] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.641499] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('83773a1e-a41f-4b44-9df1-b3c8d1937490',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.642225] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.642321] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.642387] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.642535] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.642606] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60b11f04-8768-43f5-bcb0-8bb51ec0bdf2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.645770] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e65996f-05e7-4178-bdb9-30270bc56380 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.645887] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.645951] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.646159] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.646331] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e65996f-05e7-4178-bdb9-30270bc56380',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.647433] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.647433] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.647433] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.648966] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.649069] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ed63561-0704-4a50-8dc8-a078d5c0c6f3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.650060] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d1550bb0-c88b-4864-824e-b80ca3b52834 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.650226] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.650268] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.650451] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.650525] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d1550bb0-c88b-4864-824e-b80ca3b52834',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.651537] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42a0bf4e-f927-429d-910f-f0fec4b5f3c8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.651670] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.651759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.653037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.653037] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42a0bf4e-f927-429d-910f-f0fec4b5f3c8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.653037] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.653037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.653037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.653657] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.653730] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9697a5d8-1fb8-45ef-a30e-a1b99942e3e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.654925] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6d8499f-80cb-4c22-b03a-011aac96ea05 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.655210] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.655353] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.655604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.656554] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6d8499f-80cb-4c22-b03a-011aac96ea05',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.657683] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.657822] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.657894] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.658175] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.658245] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.659163] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a07e97d-006e-4334-801f-7251980b19f1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.659278] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.659342] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.660223] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.660223] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a07e97d-006e-4334-801f-7251980b19f1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.660918] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26df6822-523e-4c95-9d74-db0cddb065c0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.660918] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.660918] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.660918] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.661221] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26df6822-523e-4c95-9d74-db0cddb065c0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.661779] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ce3cc37-b73f-4ecb-b24a-2b06775793e8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.661901] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.661961] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.662143] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.662209] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ce3cc37-b73f-4ecb-b24a-2b06775793e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.663261] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fc4077b8-3a0e-4709-8542-93ed5e2bc81e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.663403] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.663572] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.663651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.663724] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fc4077b8-3a0e-4709-8542-93ed5e2bc81e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.664555] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.664656] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.664724] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.664905] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.665014] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.665875] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4eae2009-1124-44b2-a496-3582997767b0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.666025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.666124] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.666338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.666416] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4eae2009-1124-44b2-a496-3582997767b0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.703884] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 in Status: SUCCESS [ 1055.704172] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.705414] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.705717] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.705842] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.718529] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13d294c9-5967-4aff-b987-840ca5e2ead4 in Status: SUCCESS [ 1055.718823] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.719078] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.719376] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.719665] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.720657] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.720657] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.720657] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.720657] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.720657] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.721033] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('13d294c9-5967-4aff-b987-840ca5e2ead4',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.771525] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 88dd15a6-baba-42bd-866e-1f374207d416 [ 1055.771876] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.772109] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.772226] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.773508] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.773508] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.773508] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:88dd15a6-baba-42bd-866e-1f374207d416 already deleted. [ 1055.773508] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88dd15a6-baba-42bd-866e-1f374207d416" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.061826] env[65322]: INFO networking_nsxv3.common.synchronization [req-39a9566e-4d94-4a61-9a07-24959649d2fb req-e9cd920b-f8b2-47a6-923b-765df381c329 tempest-DeleteServersTestJSON-1463403857 tempest-DeleteServersTestJSON-1463403857-project-member] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 1056.062485] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 1056.062814] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.064238] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.064353] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.064598] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.064786] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.065264] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.065264] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.065264] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.065264] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.065514] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.135153] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.135399] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.135399] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.135757] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.164229] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.164229] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.169035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.169520] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.169653] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.169720] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.169950] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.170053] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.170150] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 is going to be updated. [ 1056.176213] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.176213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.176213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.176213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.176213] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.176448] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.176448] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.176611] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.176726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.176910] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.177016] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7bf5edc0-c1b5-489c-9093-35e6cf4bd266',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.182494] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.182494] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.183167] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.183297] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.183357] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.183504] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.183653] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.183755] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.183811] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.183970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.184101] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.184101] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.184327] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.185577] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ce3cc37-b73f-4ecb-b24a-2b06775793e8 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.185577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.185577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.185577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.185805] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.185805] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.185805] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.187348] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.187348] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.187348] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.187348] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5ce3cc37-b73f-4ecb-b24a-2b06775793e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.190577] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.190577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.190577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.190577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.190577] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.190577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.190577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.191388] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.191388] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.191388] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.191388] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.207226] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.207398] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.209754] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.209882] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.210012] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.210353] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.210353] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.210644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.210644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.210831] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.210831] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.210984] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.210984] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.224375] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-13d294c9-5967-4aff-b987-840ca5e2ead4 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.224375] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.224593] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.224593] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.224759] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.224853] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.224916] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.225126] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.225213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.228669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.228669] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-13d294c9-5967-4aff-b987-840ca5e2ead4 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.228669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.228669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.228669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.228669] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.228669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.228669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.228669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.228669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.228669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.228669] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('13d294c9-5967-4aff-b987-840ca5e2ead4',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.250449] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.251471] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.251471] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.251471] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.251471] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.262692] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.263400] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.264651] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.265392] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.266414] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.267030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.268610] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.268804] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.269632] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.269796] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.270668] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.270831] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.271840] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.271840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.272840] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.272840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.274318] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.274438] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ef78971b-78bd-41bb-9a08-bdae7a3b226a is going to be deleted. [ 1056.276082] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.276082] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.281971] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: IN_PROGRESS for 2s [ 1056.287520] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.287520] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.294374] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.294374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.294374] env[65322]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1056.295193] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.295193] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.295409] env[65322]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1056.295845] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.295962] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.297527] env[65322]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1056.298014] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.298124] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.302546] env[65322]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1056.303897] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.303897] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e2419cbe-07eb-4d04-a37e-18623c658710 is going to be deleted. [ 1056.304683] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.304683] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.328996] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.328996] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26df6822-523e-4c95-9d74-db0cddb065c0 is going to be deleted. [ 1056.329449] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.329720] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.349402] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.349748] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.366019] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.366287] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be deleted. [ 1056.367270] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.367508] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.371517] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.371661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.405939] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.405939] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 is going to be deleted. [ 1056.406651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.406886] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.411405] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.411596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.449035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.449300] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6d8499f-80cb-4c22-b03a-011aac96ea05 is going to be deleted. [ 1056.450537] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.450802] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.491264] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.491532] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4eae2009-1124-44b2-a496-3582997767b0 is going to be deleted. [ 1056.492372] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.492610] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.497330] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.497646] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.508064] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.508304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.528478] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.528661] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a07e97d-006e-4334-801f-7251980b19f1 is going to be deleted. [ 1056.529588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.529810] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.554351] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.554549] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.554672] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.554965] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.555919] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.556149] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.556276] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.556798] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.557259] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.557259] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1056.557759] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1056.557759] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1056.557887] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1056.557926] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1056.558023] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1056.558159] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1056.568633] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.568848] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.602679] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.602850] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.603928] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.604084] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60b11f04-8768-43f5-bcb0-8bb51ec0bdf2 is going to be deleted. [ 1056.605153] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.605406] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.617055] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1056.617391] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.059 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1056.617486] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1056.617632] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.617957] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-e98b4ac6-7f0a-453b-bb53-dc1a62d48291 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.618154] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-e98b4ac6-7f0a-453b-bb53-dc1a62d48291" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.618276] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-e98b4ac6-7f0a-453b-bb53-dc1a62d48291" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.618632] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-e98b4ac6-7f0a-453b-bb53-dc1a62d48291" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.618761] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e98b4ac6-7f0a-453b-bb53-dc1a62d48291',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.627086] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.627283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.676235] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.676386] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.699998] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.703767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.703767] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 83773a1e-a41f-4b44-9df1-b3c8d1937490 is going to be deleted. [ 1056.704680] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.705211] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.709580] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.709580] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.709580] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.709580] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.709580] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.709580] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.709580] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.709580] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.709580] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.710057] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.710057] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.710057] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.710057] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.710209] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.710244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.710926] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.710926] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.710926] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.710926] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.710926] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.711372] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.711372] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.711372] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7bf5edc0-c1b5-489c-9093-35e6cf4bd266',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.712380] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.712380] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.712488] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.712653] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.716726] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.716726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.716726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.716726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.716726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.716726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.716726] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.716726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.716726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.716726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.716726] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.716726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.716726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.716726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.716726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.717685] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.717685] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.718843] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5ce3cc37-b73f-4ecb-b24a-2b06775793e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.723034] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.723288] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.723326] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.723574] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.723789] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.723930] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.724317] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.724699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.724826] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.725424] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.725424] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.725582] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.725582] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.725746] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.725916] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.726046] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.726143] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.726330] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.726417] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.726512] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.726650] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.749895] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 13d294c9-5967-4aff-b987-840ca5e2ead4: rpc.has_security_group_logging(os_id): False [ 1056.795843] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.795843] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9697a5d8-1fb8-45ef-a30e-a1b99942e3e8 is going to be deleted. [ 1056.796828] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.797060] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.804085] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.804311] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.834782] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.834955] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fc4077b8-3a0e-4709-8542-93ed5e2bc81e is going to be deleted. [ 1056.836169] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.836432] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.845994] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.846224] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.915852] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.915993] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d1550bb0-c88b-4864-824e-b80ca3b52834 is going to be deleted. [ 1056.916974] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.917205] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.973321] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.973533] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.986397] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.986555] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.990971] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.991244] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e65996f-05e7-4178-bdb9-30270bc56380 is going to be deleted. [ 1056.992155] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.992367] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.992527] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.992579] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 is going to be deleted. [ 1056.993495] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.993706] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.993796] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.993920] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ef78971b-78bd-41bb-9a08-bdae7a3b226a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.994537] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.995260] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.995260] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.995260] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e2419cbe-07eb-4d04-a37e-18623c658710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.995504] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.995664] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.995743] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.995861] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26df6822-523e-4c95-9d74-db0cddb065c0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.995998] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.996204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.996332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.996389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.996523] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.996660] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.996733] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.996837] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.997010] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.997346] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.997532] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.997659] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.997811] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.997811] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.997969] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.998034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.998192] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be deleted. [ 1056.999913] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.999913] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.999913] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.999913] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6d8499f-80cb-4c22-b03a-011aac96ea05" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.999913] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.000099] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.000099] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.000199] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4eae2009-1124-44b2-a496-3582997767b0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.002619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.002619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.002619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.002619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a07e97d-006e-4334-801f-7251980b19f1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.002619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.002619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.002619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.002619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60b11f04-8768-43f5-bcb0-8bb51ec0bdf2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.002619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.002619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.002619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.002619] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.002619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.002619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.002619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.002619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.002619] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.003311] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.003311] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.003311] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.003311] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.003311] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.003311] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.003311] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.003631] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.003631] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.003631] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 13d294c9-5967-4aff-b987-840ca5e2ead4 is going to be created. [ 1057.004621] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.004781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.004863] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.004980] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-83773a1e-a41f-4b44-9df1-b3c8d1937490" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.005150] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.005294] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.005368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.005509] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9697a5d8-1fb8-45ef-a30e-a1b99942e3e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.005621] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.005753] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.005824] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.005929] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fc4077b8-3a0e-4709-8542-93ed5e2bc81e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.072955] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.073468] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.073468] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.073468] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.073638] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.073638] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.111663] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.111663] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.111663] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.111663] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.111663] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.111663] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d1550bb0-c88b-4864-824e-b80ca3b52834" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.122421] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.122747] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.122920] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.123299] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.123452] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.123661] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port e98b4ac6-7f0a-453b-bb53-dc1a62d48291 not found, creating... [ 1057.125211] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.125211] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.125211] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.125211] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.125211] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.125792] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.126209] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.126463] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.126806] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.127145] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.127496] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: e98b4ac6-7f0a-453b-bb53-dc1a62d48291 is going to be created. [ 1057.159264] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.159524] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.159524] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.160931] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.161322] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.161559] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.164652] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.165282] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.165282] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.165542] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.165673] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.165828] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e65996f-05e7-4178-bdb9-30270bc56380" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.173979] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.174190] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.174234] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.176023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.176023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.203771] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d: rpc.has_security_group_logging(os_id): False [ 1057.206983] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.207652] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.207918] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.209020] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.209020] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.209300] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-e98b4ac6-7f0a-453b-bb53-dc1a62d48291" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.211931] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13d294c9-5967-4aff-b987-840ca5e2ead4 in Status: IN_PROGRESS for 2s [ 1057.220874] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a34cfbc5-e3ce-4943-8058-702a82703915: rpc.has_security_group_logging(os_id): False [ 1057.224854] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7bf5edc0-c1b5-489c-9093-35e6cf4bd266: rpc.has_security_group_logging(os_id): False [ 1057.224854] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5ce3cc37-b73f-4ecb-b24a-2b06775793e8: rpc.has_security_group_logging(os_id): False [ 1057.229807] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d8cdb67-7719-40d5-8ef7-63d3e76937f0: rpc.has_security_group_logging(os_id): False [ 1057.283060] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.283060] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.283060] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.283693] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.286319] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.286543] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.287591] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.287591] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.287999] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.288166] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.288797] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.288915] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.361735] env[65322]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1057.362545] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.363176] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.363420] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.363756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.364115] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.364269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.364439] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 is going to be updated. [ 1057.366396] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.366396] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.438428] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.438718] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.438853] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.438920] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.439180] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.439272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.439508] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.440446] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.440446] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.440446] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.440446] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.440446] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.440446] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.441170] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.441170] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.441170] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.441170] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 is going to be updated. [ 1057.442493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.442493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.493965] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.494245] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.494984] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.495242] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.495372] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.495436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.495629] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.496256] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.496256] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.496256] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.496615] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.496668] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.496763] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.496940] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.497023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.497086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.497233] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.497308] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.497403] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 is going to be updated. [ 1057.499013] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.499136] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.568282] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.568652] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.568796] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.568862] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.569106] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.569195] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.569480] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.569634] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.569709] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.569893] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.570068] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.572771] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.572771] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.572771] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.572771] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.572771] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.572771] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 is going to be updated. [ 1057.572771] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.572771] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.573306] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.576363] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.576363] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.621739] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.621863] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.636390] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 in Status: IN_PROGRESS for 2s [ 1057.647847] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.648345] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.648451] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.648518] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.648733] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.648816] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.648911] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d is going to be updated. [ 1057.650461] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.650812] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.651607] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.667600] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 in Status: IN_PROGRESS for 2s [ 1057.687839] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.688397] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.688397] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.688397] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.688639] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.710283] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.710283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.710283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.710283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.710283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.737167] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 in Status: IN_PROGRESS for 2s [ 1057.739042] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: IN_PROGRESS for 2s [ 1057.764334] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.764548] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.764548] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.765213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.765331] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.844432] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: IN_PROGRESS for 2s [ 1057.948107] env[65322]: INFO networking_nsxv3.common.synchronization [req-39a9566e-4d94-4a61-9a07-24959649d2fb req-0c14594f-ecc3-4278-80fd-f3e6c6ea7ed5 service nova] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_rules [ 1057.948281] env[65322]: INFO networking_nsxv3.common.synchronization [req-39a9566e-4d94-4a61-9a07-24959649d2fb req-0c14594f-ecc3-4278-80fd-f3e6c6ea7ed5 service nova] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 1057.948410] env[65322]: INFO networking_nsxv3.common.synchronization [req-39a9566e-4d94-4a61-9a07-24959649d2fb req-0c14594f-ecc3-4278-80fd-f3e6c6ea7ed5 service nova] Enqueued Resource ID: e98b4ac6-7f0a-453b-bb53-dc1a62d48291 with Priority: HIGHEST for action port [ 1057.949161] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_rules [ 1057.949161] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 1057.949322] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e98b4ac6-7f0a-453b-bb53-dc1a62d48291 with Priority: HIGHEST for action port [ 1057.949517] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.950550] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.950550] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.950550] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.950550] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.954471] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.954471] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.954471] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.954471] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.954638] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.954746] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.954833] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.955733] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.955733] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.955733] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.956528] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-e98b4ac6-7f0a-453b-bb53-dc1a62d48291 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.956660] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e98b4ac6-7f0a-453b-bb53-dc1a62d48291" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.956744] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e98b4ac6-7f0a-453b-bb53-dc1a62d48291" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.956920] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e98b4ac6-7f0a-453b-bb53-dc1a62d48291" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.957030] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e98b4ac6-7f0a-453b-bb53-dc1a62d48291',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.296870] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 in Status: SUCCESS [ 1058.296870] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ed63561-0704-4a50-8dc8-a078d5c0c6f3 deletion is rescheduled due to dependency. [ 1058.296870] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ed63561-0704-4a50-8dc8-a078d5c0c6f3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.376915] env[65322]: INFO networking_nsxv3.common.synchronization [None req-9e6ecd01-0628-4a6a-b564-f0b0e37ed443 None None] Enqueued Resource ID: 9dc0dbca-dfac-4295-a3eb-22a8aa874c9f with Priority: HIGHEST for action port [ 1058.377675] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dc0dbca-dfac-4295-a3eb-22a8aa874c9f with Priority: HIGHEST for action port [ 1058.378250] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-9dc0dbca-dfac-4295-a3eb-22a8aa874c9f taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.378432] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9dc0dbca-dfac-4295-a3eb-22a8aa874c9f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.378538] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9dc0dbca-dfac-4295-a3eb-22a8aa874c9f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.378922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9dc0dbca-dfac-4295-a3eb-22a8aa874c9f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.379058] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dc0dbca-dfac-4295-a3eb-22a8aa874c9f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.461514] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.461653] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.463176] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.463176] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e98b4ac6-7f0a-453b-bb53-dc1a62d48291 with status ACTIVE [ 1058.463999] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.464173] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.464238] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.464459] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.464598] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.464784] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.464875] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.464934] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.465266] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.465371] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.465555] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.465667] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.465724] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.465870] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.465935] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.466033] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e98b4ac6-7f0a-453b-bb53-dc1a62d48291 is going to be updated. [ 1058.490478] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.490736] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.490736] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.491052] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.491184] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.491276] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e98b4ac6-7f0a-453b-bb53-dc1a62d48291" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.773402] env[65322]: INFO networking_nsxv3.common.synchronization [req-7084f405-f5e0-402b-9406-f09d63796620 req-73e79658-8df0-40b3-aeef-56e3eab6dbb4 tempest-ServerTagsTestJSON-102347801 tempest-ServerTagsTestJSON-102347801-project-member] Enqueued Resource ID: eaa0f90e-1315-418b-970b-11723b551de1 with Priority: HIGHEST for action security_group_members [ 1058.773948] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaa0f90e-1315-418b-970b-11723b551de1 with Priority: HIGHEST for action security_group_members [ 1058.774280] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-eaa0f90e-1315-418b-970b-11723b551de1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.774406] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.774466] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.776128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.776128] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.776128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.776128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.776128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.776128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.776128] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eaa0f90e-1315-418b-970b-11723b551de1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.883023] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9dc0dbca-dfac-4295-a3eb-22a8aa874c9f [ 1058.883266] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.883408] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.883476] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.883783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.883881] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.883975] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9dc0dbca-dfac-4295-a3eb-22a8aa874c9f already deleted. [ 1058.884074] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9dc0dbca-dfac-4295-a3eb-22a8aa874c9f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.967898] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.226866] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 13d294c9-5967-4aff-b987-840ca5e2ead4 in Status: SUCCESS [ 1059.227059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.283328] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.283536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.283602] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.283830] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.316085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.316412] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.316412] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.316594] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.316649] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.317408] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.317408] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaa0f90e-1315-418b-970b-11723b551de1 is going to be updated. [ 1059.357519] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.357744] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.357744] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.357955] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.358116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.369023] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa0f90e-1315-418b-970b-11723b551de1 in Status: IN_PROGRESS for 2s [ 1059.470660] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.470824] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.470896] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.471158] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.471256] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.471355] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be created. [ 1059.496722] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.496885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.496931] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.497772] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.497772] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.516030] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: UNINITIALIZED for 2s [ 1059.652205] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 in Status: SUCCESS [ 1059.652205] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.682179] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 in Status: SUCCESS [ 1059.682589] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.761883] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: SUCCESS [ 1059.762171] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.763765] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 in Status: SUCCESS [ 1059.763887] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.861184] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: SUCCESS [ 1059.861442] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.381116] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eaa0f90e-1315-418b-970b-11723b551de1 in Status: SUCCESS [ 1061.381504] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eaa0f90e-1315-418b-970b-11723b551de1 deletion is rescheduled due to dependency. [ 1061.381504] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eaa0f90e-1315-418b-970b-11723b551de1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.528424] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: SUCCESS [ 1061.528658] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.528831] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.529064] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.529259] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.529377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.529437] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.529586] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.529660] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.529738] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.529826] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.032669] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.032869] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.032920] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.033199] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.033337] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.033460] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.033501] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.033645] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.033729] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.033817] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.033960] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.034102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.034156] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.034298] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.034433] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.034540] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.034592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.034705] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.034775] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.034852] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.034942] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.537920] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e863a544-814a-4bca-b4b1-35f9a61afcd3: rpc.has_security_group_logging(os_id): False [ 1062.557499] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.557499] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.557904] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.557904] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.557904] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.558214] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.558214] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.558214] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.558464] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.558518] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.558779] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.558969] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.558969] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.559128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.559128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.559607] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.559729] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.559800] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.559992] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.559992] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.560428] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be created. [ 1062.660270] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.660475] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.660517] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.661301] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.661301] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.692969] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: IN_PROGRESS for 2s [ 1063.120735] env[65322]: INFO networking_nsxv3.common.synchronization [None req-99d69be9-0e4d-4b01-b9fb-b9e12b207093 tempest-AttachVolumeShelveTestJSON-315803451 tempest-AttachVolumeShelveTestJSON-315803451-project-member] Enqueued Resource ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 with Priority: HIGHEST for action security_group_rules [ 1063.121097] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 with Priority: HIGHEST for action security_group_rules [ 1063.121615] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5b6c61f-b9c6-44e9-934b-c9925befabf7 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.121906] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.122102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.122482] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.122780] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5b6c61f-b9c6-44e9-934b-c9925befabf7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.502900] env[65322]: INFO networking_nsxv3.common.synchronization [None req-95e41e3b-4629-42d3-ae1d-62f465d0c2d7 tempest-AttachVolumeShelveTestJSON-315803451 tempest-AttachVolumeShelveTestJSON-315803451-project-member] Enqueued Resource ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 with Priority: HIGHEST for action security_group_rules [ 1063.503660] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 with Priority: HIGHEST for action security_group_rules [ 1063.503797] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5b6c61f-b9c6-44e9-934b-c9925befabf7 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.503887] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.587414] env[65322]: INFO networking_nsxv3.common.synchronization [None req-e5b8b0fd-3f98-44e7-83d5-adb5f08c2c63 tempest-AttachVolumeTestJSON-1389790413 tempest-AttachVolumeTestJSON-1389790413-project-member] Enqueued Resource ID: ff72da15-0579-4c17-8921-0de51b66ecbf with Priority: HIGHEST for action security_group_rules [ 1063.587818] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff72da15-0579-4c17-8921-0de51b66ecbf with Priority: HIGHEST for action security_group_rules [ 1063.587883] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff72da15-0579-4c17-8921-0de51b66ecbf taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.587992] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.588660] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.588985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.589239] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff72da15-0579-4c17-8921-0de51b66ecbf',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.648213] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.648427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.648427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.648612] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.648698] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.648790] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 already deleted. [ 1063.648870] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.649021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.649203] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.649287] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5b6c61f-b9c6-44e9-934b-c9925befabf7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.017936] env[65322]: INFO networking_nsxv3.common.synchronization [None req-1adbe898-89f3-4b7b-ae51-50d24605a797 tempest-AttachVolumeTestJSON-1389790413 tempest-AttachVolumeTestJSON-1389790413-project-member] Enqueued Resource ID: ff72da15-0579-4c17-8921-0de51b66ecbf with Priority: HIGHEST for action security_group_rules [ 1064.018682] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff72da15-0579-4c17-8921-0de51b66ecbf with Priority: HIGHEST for action security_group_rules [ 1064.019048] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff72da15-0579-4c17-8921-0de51b66ecbf taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.019178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.114934] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.115449] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.115525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.115850] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.115963] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.116138] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff72da15-0579-4c17-8921-0de51b66ecbf already deleted. [ 1064.116299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.116523] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.116844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.116844] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff72da15-0579-4c17-8921-0de51b66ecbf',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.182042] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.182042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.182042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.182042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.182042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.182042] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 already deleted. [ 1064.182042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.639789] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.640170] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.640170] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.641757] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.641757] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.641757] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff72da15-0579-4c17-8921-0de51b66ecbf already deleted. [ 1064.641757] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.713503] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: SUCCESS [ 1064.714649] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.335737] env[65322]: INFO networking_nsxv3.common.synchronization [req-6cd3e1df-627b-442e-8fe4-d6b80f3d39b4 req-f753b091-14c1-45de-aac3-5e8e9d4206ba tempest-ServerDiskConfigTestJSON-1167155511 tempest-ServerDiskConfigTestJSON-1167155511-project-member] Enqueued Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 1065.335737] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 1065.335737] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.335737] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.335737] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.336585] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.336585] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.336585] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.336585] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.336585] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.336585] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.336585] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.840070] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.840543] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.840543] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.840676] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.840816] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.841096] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.841262] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.841330] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.841541] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.841626] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.841736] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 is going to be updated. [ 1065.876023] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.876023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.876023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.876023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.876023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.884981] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: IN_PROGRESS for 2s [ 1066.768869] env[65322]: INFO networking_nsxv3.common.synchronization [req-edecccbb-d3de-4803-90b6-ccb790284807 req-b74933a4-e4aa-4e83-b94c-b2eb8f76cc66 tempest-ServerMetadataTestJSON-2000705504 tempest-ServerMetadataTestJSON-2000705504-project-member] Enqueued Resource ID: de8176a8-b776-46da-b656-af62ce663e0d with Priority: HIGHEST for action security_group_members [ 1066.769580] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de8176a8-b776-46da-b656-af62ce663e0d with Priority: HIGHEST for action security_group_members [ 1066.769908] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-de8176a8-b776-46da-b656-af62ce663e0d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.770061] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.770200] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.770522] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.770818] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.770962] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.771029] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.771185] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.771272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.771420] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de8176a8-b776-46da-b656-af62ce663e0d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.162715] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-438 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.163090] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-438" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.163090] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-438" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.163484] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-438" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.163705] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.163863] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.163977] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.164389] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.164875] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.165205] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1067.165320] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1067.165466] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1067.165601] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1067.165744] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1067.165884] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1067.166075] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1067.184323] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1067.184481] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1067.184700] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1067.184927] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-438" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.185299] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-2ebade21-896b-4f24-812e-779cf1d39674 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.185484] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-2ebade21-896b-4f24-812e-779cf1d39674" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.185684] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-2ebade21-896b-4f24-812e-779cf1d39674" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.186041] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-2ebade21-896b-4f24-812e-779cf1d39674" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.186246] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ebade21-896b-4f24-812e-779cf1d39674',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.273331] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.273519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.273560] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.273784] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.273868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.274070] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.274181] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.274255] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.274406] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.274481] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.274577] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de8176a8-b776-46da-b656-af62ce663e0d already deleted. [ 1067.274676] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.689513] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.689744] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.689877] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.690234] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.690490] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.690737] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 2ebade21-896b-4f24-812e-779cf1d39674 not found, creating... [ 1067.691125] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.691325] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.691474] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.692124] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.692277] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.692578] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.692847] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.692992] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.693322] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.693773] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.694074] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 2ebade21-896b-4f24-812e-779cf1d39674 is going to be created. [ 1067.719222] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.719222] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.719222] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.720612] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.720612] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.720612] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-2ebade21-896b-4f24-812e-779cf1d39674" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.895796] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: SUCCESS [ 1067.895796] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 deletion is rescheduled due to dependency. [ 1067.895796] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.498020] env[65322]: INFO networking_nsxv3.common.synchronization [req-edecccbb-d3de-4803-90b6-ccb790284807 req-7985c95d-1155-4ac5-a374-a42ed02e4b72 service nova] Enqueued Resource ID: de8176a8-b776-46da-b656-af62ce663e0d with Priority: HIGHEST for action security_group_rules [ 1068.498020] env[65322]: INFO networking_nsxv3.common.synchronization [req-edecccbb-d3de-4803-90b6-ccb790284807 req-7985c95d-1155-4ac5-a374-a42ed02e4b72 service nova] Enqueued Resource ID: de8176a8-b776-46da-b656-af62ce663e0d with Priority: HIGHEST for action security_group_members [ 1068.498020] env[65322]: INFO networking_nsxv3.common.synchronization [req-edecccbb-d3de-4803-90b6-ccb790284807 req-7985c95d-1155-4ac5-a374-a42ed02e4b72 service nova] Enqueued Resource ID: 2ebade21-896b-4f24-812e-779cf1d39674 with Priority: HIGHEST for action port [ 1068.498020] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de8176a8-b776-46da-b656-af62ce663e0d with Priority: HIGHEST for action security_group_rules [ 1068.498020] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de8176a8-b776-46da-b656-af62ce663e0d with Priority: HIGHEST for action security_group_members [ 1068.498020] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ebade21-896b-4f24-812e-779cf1d39674 with Priority: HIGHEST for action port [ 1068.498020] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de8176a8-b776-46da-b656-af62ce663e0d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.500969] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.503436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.503436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.503593] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de8176a8-b776-46da-b656-af62ce663e0d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.504717] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-de8176a8-b776-46da-b656-af62ce663e0d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.504717] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.504982] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.504982] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.505112] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.505251] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.505290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.505458] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.505532] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.505600] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de8176a8-b776-46da-b656-af62ce663e0d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.510184] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ebade21-896b-4f24-812e-779cf1d39674 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.510184] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ebade21-896b-4f24-812e-779cf1d39674" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.510184] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ebade21-896b-4f24-812e-779cf1d39674" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.510184] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ebade21-896b-4f24-812e-779cf1d39674" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.510184] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ebade21-896b-4f24-812e-779cf1d39674',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.011160] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de8176a8-b776-46da-b656-af62ce663e0d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.012846] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-de8176a8-b776-46da-b656-af62ce663e0d taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.012846] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.017232] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ebade21-896b-4f24-812e-779cf1d39674 with status ACTIVE [ 1069.017232] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.017232] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.017232] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.017232] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.017232] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.017232] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.017232] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.017232] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.017232] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.017232] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.017232] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.017232] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.017232] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.017232] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.017232] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.017232] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ebade21-896b-4f24-812e-779cf1d39674 is going to be updated. [ 1069.043984] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.044126] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.044196] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.044422] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.044746] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.044746] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ebade21-896b-4f24-812e-779cf1d39674" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.520313] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de8176a8-b776-46da-b656-af62ce663e0d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.023567] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.023748] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.023853] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.024405] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.024405] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.024405] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de8176a8-b776-46da-b656-af62ce663e0d is going to be created. [ 1070.053875] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.054068] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.054136] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.054390] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.054802] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.066207] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de8176a8-b776-46da-b656-af62ce663e0d in Status: UNINITIALIZED for 2s [ 1071.278748] env[65322]: INFO networking_nsxv3.common.synchronization [req-b7a95110-e88e-492c-8d88-e57b88a59f8b req-9675ec67-fc7c-4bfb-972e-f7d3cd256bed tempest-ServerRescueNegativeTestJSON-325476461 tempest-ServerRescueNegativeTestJSON-325476461-project-member] Enqueued Resource ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 with Priority: HIGHEST for action security_group_members [ 1071.279400] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 with Priority: HIGHEST for action security_group_members [ 1071.279757] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.279897] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.280108] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.283856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.283856] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.283856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.283856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.283856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.283856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.283856] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bf5edc0-c1b5-489c-9093-35e6cf4bd266',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.785275] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7bf5edc0-c1b5-489c-9093-35e6cf4bd266',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.084224] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de8176a8-b776-46da-b656-af62ce663e0d in Status: SUCCESS [ 1072.084357] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.084486] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.084735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.085845] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.086529] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.086529] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.086529] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.086668] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.086701] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.086831] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de8176a8-b776-46da-b656-af62ce663e0d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.289752] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7bf5edc0-c1b5-489c-9093-35e6cf4bd266',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.592050] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-de8176a8-b776-46da-b656-af62ce663e0d taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.593534] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.594095] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.594095] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.594258] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.594327] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.594735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.594735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.594735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.594735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.594913] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-de8176a8-b776-46da-b656-af62ce663e0d taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.594968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.595739] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.595739] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.595739] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.595739] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.595739] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.596041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.596041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.596041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.597053] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de8176a8-b776-46da-b656-af62ce663e0d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.792308] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.792480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.792550] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.792782] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.792892] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.792990] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 is going to be updated. [ 1072.835518] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.835518] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.835518] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.835518] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.835518] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.845913] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 in Status: IN_PROGRESS for 2s [ 1072.948478] env[65322]: INFO networking_nsxv3.common.synchronization [req-d3628187-e652-46d9-9ec8-736d1ab11553 req-459cd8c4-dcf0-4212-b3ae-3accfcbe3b52 tempest-ServerActionsTestOtherA-1162989957 tempest-ServerActionsTestOtherA-1162989957-project-member] Enqueued Resource ID: 67117db1-586f-43f8-920a-dd7b8767d9ec with Priority: HIGHEST for action security_group_members [ 1072.949160] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67117db1-586f-43f8-920a-dd7b8767d9ec with Priority: HIGHEST for action security_group_members [ 1072.949576] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-67117db1-586f-43f8-920a-dd7b8767d9ec taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.949744] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.949849] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.950261] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.950367] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.950426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.950462] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.950615] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.951187] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.951187] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67117db1-586f-43f8-920a-dd7b8767d9ec',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.100539] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de8176a8-b776-46da-b656-af62ce663e0d: rpc.has_security_group_logging(os_id): False [ 1073.120011] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.120011] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.120011] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.120011] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.120357] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.120357] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.120572] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.120692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.120852] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.120915] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.121105] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.121220] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.121356] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.121425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.121505] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.121787] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.121787] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.121902] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.121940] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.122024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.122129] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de8176a8-b776-46da-b656-af62ce663e0d is going to be created. [ 1073.182615] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.182819] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.182819] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.182982] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.183226] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.197981] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de8176a8-b776-46da-b656-af62ce663e0d in Status: IN_PROGRESS for 2s [ 1073.453477] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.453885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.453885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.453975] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.477229] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.477512] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.477641] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.477710] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.477901] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.478037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.478090] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67117db1-586f-43f8-920a-dd7b8767d9ec is going to be updated. [ 1073.508484] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.508484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.508484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.508484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.508717] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.519053] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67117db1-586f-43f8-920a-dd7b8767d9ec in Status: IN_PROGRESS for 2s [ 1074.861022] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 in Status: SUCCESS [ 1074.861022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.896928] env[65322]: INFO networking_nsxv3.common.synchronization [req-12359554-7430-4972-ab72-eb2a5dc595d0 req-dace99dd-ae35-4fca-a4b3-2b1b98a0e55b tempest-ServerDiskConfigTestJSON-1167155511 tempest-ServerDiskConfigTestJSON-1167155511-project-member] Enqueued Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 1074.899823] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 1074.900175] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.900292] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.900357] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.900559] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.900704] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.900796] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.900852] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.900993] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.901086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.901317] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.210534] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de8176a8-b776-46da-b656-af62ce663e0d in Status: SUCCESS [ 1075.210770] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.270502] env[65322]: INFO networking_nsxv3.common.synchronization [req-fd78f273-2b97-442e-9a14-859931833f51 req-4344bca4-1a49-41aa-8459-7b7c0fded14b tempest-DeleteServersTestJSON-1463403857 tempest-DeleteServersTestJSON-1463403857-project-member] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 1075.271172] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 1075.271532] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.271700] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.271775] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.271986] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.272158] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.272272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.272314] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.272578] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.272681] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.272970] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.291184] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-173 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.291792] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-173" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.291792] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-173" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.291792] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-173" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.292118] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.292323] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.292431] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.292656] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.292792] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.293010] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1075.293136] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1075.293229] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1075.293332] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1075.293435] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1075.293534] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1075.293664] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1075.319632] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1075.319859] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1075.320310] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1075.320310] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-173" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.320532] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-896ef7e7-23d3-4d4f-bf4c-1bf0e8c3f5bf taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.320693] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-896ef7e7-23d3-4d4f-bf4c-1bf0e8c3f5bf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.320803] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-896ef7e7-23d3-4d4f-bf4c-1bf0e8c3f5bf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.321474] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-896ef7e7-23d3-4d4f-bf4c-1bf0e8c3f5bf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.321474] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('896ef7e7-23d3-4d4f-bf4c-1bf0e8c3f5bf',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.404094] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.404290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.404401] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.404675] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.404776] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.405100] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.405232] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.405323] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.405490] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.405586] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.405677] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 is going to be updated. [ 1075.434824] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.434996] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.435049] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.435417] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.435492] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.445397] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: IN_PROGRESS for 2s [ 1075.528862] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67117db1-586f-43f8-920a-dd7b8767d9ec in Status: SUCCESS [ 1075.529051] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67117db1-586f-43f8-920a-dd7b8767d9ec deletion is rescheduled due to dependency. [ 1075.529194] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67117db1-586f-43f8-920a-dd7b8767d9ec" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.775340] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.775611] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.775688] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.775921] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.776030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.776635] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.776907] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.777013] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.777275] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.777395] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.777711] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be updated. [ 1075.812232] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.812422] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.812496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.812712] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.812910] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.825081] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.825499] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.825683] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.825990] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.826732] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.826732] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 896ef7e7-23d3-4d4f-bf4c-1bf0e8c3f5bf not found, creating... [ 1075.826938] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.827093] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.827247] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.827633] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.827845] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.828401] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.828653] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.828839] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.829171] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.829410] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.829609] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 896ef7e7-23d3-4d4f-bf4c-1bf0e8c3f5bf is going to be created. [ 1075.832033] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: IN_PROGRESS for 2s [ 1075.856071] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.856448] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.856622] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.856930] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.857175] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.857407] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-896ef7e7-23d3-4d4f-bf4c-1bf0e8c3f5bf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.576024] env[65322]: INFO networking_nsxv3.common.synchronization [req-12359554-7430-4972-ab72-eb2a5dc595d0 req-4cd20c98-fcdb-48d3-ab9d-405b0ee1d959 service nova] Enqueued Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_rules [ 1076.576802] env[65322]: INFO networking_nsxv3.common.synchronization [req-12359554-7430-4972-ab72-eb2a5dc595d0 req-4cd20c98-fcdb-48d3-ab9d-405b0ee1d959 service nova] Enqueued Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 1076.576802] env[65322]: INFO networking_nsxv3.common.synchronization [req-12359554-7430-4972-ab72-eb2a5dc595d0 req-4cd20c98-fcdb-48d3-ab9d-405b0ee1d959 service nova] Enqueued Resource ID: 896ef7e7-23d3-4d4f-bf4c-1bf0e8c3f5bf with Priority: HIGHEST for action port [ 1076.576802] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_rules [ 1076.576994] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 1076.577116] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 896ef7e7-23d3-4d4f-bf4c-1bf0e8c3f5bf with Priority: HIGHEST for action port [ 1076.577329] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.577420] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.577500] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.577722] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.577814] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.578687] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.578782] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.578967] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-896ef7e7-23d3-4d4f-bf4c-1bf0e8c3f5bf taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.579681] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-896ef7e7-23d3-4d4f-bf4c-1bf0e8c3f5bf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.579681] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-896ef7e7-23d3-4d4f-bf4c-1bf0e8c3f5bf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.579681] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-896ef7e7-23d3-4d4f-bf4c-1bf0e8c3f5bf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.579681] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('896ef7e7-23d3-4d4f-bf4c-1bf0e8c3f5bf',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.081148] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.081307] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.081481] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 896ef7e7-23d3-4d4f-bf4c-1bf0e8c3f5bf with status ACTIVE [ 1077.081678] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.081799] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.081867] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.082126] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.082229] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.082405] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.082502] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.082594] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.082923] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.082923] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.083018] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.083127] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.083173] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.083316] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.083382] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.083486] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 896ef7e7-23d3-4d4f-bf4c-1bf0e8c3f5bf is going to be updated. [ 1077.112742] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.112924] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.113024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.113358] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.113453] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.113604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-896ef7e7-23d3-4d4f-bf4c-1bf0e8c3f5bf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.180701] env[65322]: INFO networking_nsxv3.common.synchronization [req-a2682cad-6010-46b7-bc04-8ee8b9f6bd86 req-1132d3af-bddf-482f-8a8c-464d6ec9e6a3 tempest-AttachVolumeShelveTestJSON-315803451 tempest-AttachVolumeShelveTestJSON-315803451-project-member] Enqueued Resource ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 with Priority: HIGHEST for action security_group_members [ 1077.181303] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 with Priority: HIGHEST for action security_group_members [ 1077.181643] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5b6c61f-b9c6-44e9-934b-c9925befabf7 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.181762] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.181850] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.182160] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.182336] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.182493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.182569] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.182738] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.182818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.182917] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5b6c61f-b9c6-44e9-934b-c9925befabf7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.455479] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: SUCCESS [ 1077.455673] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 deletion is rescheduled due to dependency. [ 1077.455835] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.455960] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.456190] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.456423] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.456546] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.456610] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.456786] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.456901] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.457016] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.567099] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.567501] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-547" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.567615] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-547" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.567980] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-547" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.568321] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.568952] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.568952] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.569107] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.569201] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.569407] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.569514] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.569616] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.569716] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.570020] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.570020] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.570105] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.595358] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.595647] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1077.595647] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.595762] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-547" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.596205] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-7d753267-1975-44a1-9706-13a4d42c8602 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.596385] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-7d753267-1975-44a1-9706-13a4d42c8602" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.596529] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-7d753267-1975-44a1-9706-13a4d42c8602" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.596912] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-7d753267-1975-44a1-9706-13a4d42c8602" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.597087] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d753267-1975-44a1-9706-13a4d42c8602',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.685669] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.685870] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.685922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.686129] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.686215] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.686400] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.686507] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.686553] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.686687] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.686852] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.686852] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 already deleted. [ 1077.686939] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.845834] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: SUCCESS [ 1077.846111] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 deletion is rescheduled due to dependency. [ 1077.846299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.959640] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.099792] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.100049] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.100189] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.100476] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.100648] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.100804] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 7d753267-1975-44a1-9706-13a4d42c8602 not found, creating... [ 1078.101110] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.101290] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.101404] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.101613] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.101742] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.102061] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.102219] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.102331] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.102531] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.102675] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.102818] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 7d753267-1975-44a1-9706-13a4d42c8602 is going to be created. [ 1078.127292] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.127618] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.127803] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.128215] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.128568] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.128885] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-7d753267-1975-44a1-9706-13a4d42c8602" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.462436] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.895411] env[65322]: INFO networking_nsxv3.common.synchronization [req-a2682cad-6010-46b7-bc04-8ee8b9f6bd86 req-ca3a6215-0f6e-4449-8a53-3aa3c32fe437 service nova] Enqueued Resource ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 with Priority: HIGHEST for action security_group_rules [ 1078.895695] env[65322]: INFO networking_nsxv3.common.synchronization [req-a2682cad-6010-46b7-bc04-8ee8b9f6bd86 req-ca3a6215-0f6e-4449-8a53-3aa3c32fe437 service nova] Enqueued Resource ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 with Priority: HIGHEST for action security_group_members [ 1078.895695] env[65322]: INFO networking_nsxv3.common.synchronization [req-a2682cad-6010-46b7-bc04-8ee8b9f6bd86 req-ca3a6215-0f6e-4449-8a53-3aa3c32fe437 service nova] Enqueued Resource ID: 7d753267-1975-44a1-9706-13a4d42c8602 with Priority: HIGHEST for action port [ 1078.896643] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 with Priority: HIGHEST for action security_group_rules [ 1078.896781] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 with Priority: HIGHEST for action security_group_members [ 1078.896877] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d753267-1975-44a1-9706-13a4d42c8602 with Priority: HIGHEST for action port [ 1078.897238] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5b6c61f-b9c6-44e9-934b-c9925befabf7 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.897365] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.897430] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.897689] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.897745] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5b6c61f-b9c6-44e9-934b-c9925befabf7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.898585] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5b6c61f-b9c6-44e9-934b-c9925befabf7 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.898698] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.898745] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.898915] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.899065] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.899159] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.899220] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.901211] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.901211] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.901211] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5b6c61f-b9c6-44e9-934b-c9925befabf7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.901954] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d753267-1975-44a1-9706-13a4d42c8602 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.902157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d753267-1975-44a1-9706-13a4d42c8602" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.902229] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d753267-1975-44a1-9706-13a4d42c8602" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.902393] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d753267-1975-44a1-9706-13a4d42c8602" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.902449] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d753267-1975-44a1-9706-13a4d42c8602',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.965472] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.965669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.965669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.965950] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.966018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.966106] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 is going to be updated. [ 1079.003248] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.003437] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.003476] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.003679] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.003820] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.012986] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: IN_PROGRESS for 2s [ 1079.403398] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d5b6c61f-b9c6-44e9-934b-c9925befabf7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.404224] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d753267-1975-44a1-9706-13a4d42c8602 with status ACTIVE [ 1079.405221] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.405454] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.407030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.407030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.407030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.407564] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.407564] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.407564] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.407729] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.407831] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.407979] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.408078] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.408136] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.408294] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.408407] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.408700] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d753267-1975-44a1-9706-13a4d42c8602 is going to be updated. [ 1079.410428] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5b6c61f-b9c6-44e9-934b-c9925befabf7 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.410428] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.434872] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.434872] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.434872] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.435261] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.435466] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.435731] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d753267-1975-44a1-9706-13a4d42c8602" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.905869] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d5b6c61f-b9c6-44e9-934b-c9925befabf7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.106211] env[65322]: INFO networking_nsxv3.common.synchronization [req-a2dc7d20-d91c-4f24-b7b8-e2f3b2e08495 req-a4cf0a63-6cd2-4d0d-8d6f-3acbacf6d763 tempest-AttachVolumeTestJSON-1389790413 tempest-AttachVolumeTestJSON-1389790413-project-member] Enqueued Resource ID: ff72da15-0579-4c17-8921-0de51b66ecbf with Priority: HIGHEST for action security_group_members [ 1080.107243] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff72da15-0579-4c17-8921-0de51b66ecbf with Priority: HIGHEST for action security_group_members [ 1080.107668] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff72da15-0579-4c17-8921-0de51b66ecbf taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.107668] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.107787] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.107979] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.108146] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.108251] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.108313] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.108471] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.108597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.108642] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff72da15-0579-4c17-8921-0de51b66ecbf',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.408428] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.408554] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.408636] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.409121] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.409261] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.410229] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 is going to be created. [ 1080.440331] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.440331] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.440331] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.440331] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.440331] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.451116] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 in Status: UNINITIALIZED for 2s [ 1080.472308] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-38 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.472654] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-38" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.472839] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-38" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.473180] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-38" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.473493] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.473679] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.474603] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.474603] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.474603] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.474603] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1080.474603] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1080.474879] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1080.474879] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1080.474879] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1080.474956] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1080.475056] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1080.498506] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1080.498802] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1080.499729] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1080.499972] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-38" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.500390] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-8dfdb816-cd83-46e7-9200-fa33e335340c taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.501674] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-8dfdb816-cd83-46e7-9200-fa33e335340c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.501830] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-8dfdb816-cd83-46e7-9200-fa33e335340c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.502200] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-8dfdb816-cd83-46e7-9200-fa33e335340c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.502370] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dfdb816-cd83-46e7-9200-fa33e335340c',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.610854] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.611012] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.611094] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.611324] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.611418] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.611608] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.611720] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.611790] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.611940] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.612029] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.612114] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff72da15-0579-4c17-8921-0de51b66ecbf already deleted. [ 1080.612195] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.832857] env[65322]: INFO networking_nsxv3.common.synchronization [req-b9c2c6f9-f14b-4089-bb39-a5041a7efd15 req-25bdd0c2-e910-4dd4-a610-e6b49393d258 tempest-ServerMetadataTestJSON-2000705504 tempest-ServerMetadataTestJSON-2000705504-project-member] Enqueued Resource ID: de8176a8-b776-46da-b656-af62ce663e0d with Priority: HIGHEST for action security_group_members [ 1080.833437] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de8176a8-b776-46da-b656-af62ce663e0d with Priority: HIGHEST for action security_group_members [ 1080.833735] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-de8176a8-b776-46da-b656-af62ce663e0d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.833852] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.833917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.836327] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.836941] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.837100] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.837174] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.837480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.837781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.837909] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de8176a8-b776-46da-b656-af62ce663e0d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.006047] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.006047] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.006047] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.006557] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.006557] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.006557] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 8dfdb816-cd83-46e7-9200-fa33e335340c not found, creating... [ 1081.006723] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.007601] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.007601] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.007601] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.007601] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.007601] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.007796] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.007927] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.008146] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.009900] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.009900] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 8dfdb816-cd83-46e7-9200-fa33e335340c is going to be created. [ 1081.022687] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: SUCCESS [ 1081.023413] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.023413] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.023413] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.024123] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.024123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.024123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.024123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.024123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.024123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.024123] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.030734] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.030969] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.031104] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.031352] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.031624] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.031871] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-8dfdb816-cd83-46e7-9200-fa33e335340c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.340667] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.340838] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.340900] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.341134] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.341225] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.341425] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.341525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.341586] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.341735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.341808] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.341893] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de8176a8-b776-46da-b656-af62ce663e0d is going to be updated. [ 1081.373099] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.373332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.373332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.373910] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.374068] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.384883] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de8176a8-b776-46da-b656-af62ce663e0d in Status: IN_PROGRESS for 2s [ 1081.528579] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.528579] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.528579] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.528579] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.528579] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.528579] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.528579] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.528579] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.528579] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.528579] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.528579] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.529028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.529028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.529028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.529028] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.529157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.529157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.529310] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.529394] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.529477] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.529567] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.753025] env[65322]: INFO networking_nsxv3.common.synchronization [req-a2dc7d20-d91c-4f24-b7b8-e2f3b2e08495 req-99bded67-e9a1-42db-99d0-0bc976a61d15 service nova] Enqueued Resource ID: ff72da15-0579-4c17-8921-0de51b66ecbf with Priority: HIGHEST for action security_group_rules [ 1081.753025] env[65322]: INFO networking_nsxv3.common.synchronization [req-a2dc7d20-d91c-4f24-b7b8-e2f3b2e08495 req-99bded67-e9a1-42db-99d0-0bc976a61d15 service nova] Enqueued Resource ID: ff72da15-0579-4c17-8921-0de51b66ecbf with Priority: HIGHEST for action security_group_members [ 1081.753025] env[65322]: INFO networking_nsxv3.common.synchronization [req-a2dc7d20-d91c-4f24-b7b8-e2f3b2e08495 req-99bded67-e9a1-42db-99d0-0bc976a61d15 service nova] Enqueued Resource ID: 8dfdb816-cd83-46e7-9200-fa33e335340c with Priority: HIGHEST for action port [ 1081.753025] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff72da15-0579-4c17-8921-0de51b66ecbf with Priority: HIGHEST for action security_group_rules [ 1081.753025] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff72da15-0579-4c17-8921-0de51b66ecbf with Priority: HIGHEST for action security_group_members [ 1081.753025] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dfdb816-cd83-46e7-9200-fa33e335340c with Priority: HIGHEST for action port [ 1081.753025] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff72da15-0579-4c17-8921-0de51b66ecbf taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.753025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.753025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.753025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.753025] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff72da15-0579-4c17-8921-0de51b66ecbf',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.754748] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff72da15-0579-4c17-8921-0de51b66ecbf taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.755964] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.756423] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.756733] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.759109] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.759109] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.759109] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.759109] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.759109] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.759109] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff72da15-0579-4c17-8921-0de51b66ecbf',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.759109] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dfdb816-cd83-46e7-9200-fa33e335340c taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.759109] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dfdb816-cd83-46e7-9200-fa33e335340c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.759109] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dfdb816-cd83-46e7-9200-fa33e335340c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.759109] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dfdb816-cd83-46e7-9200-fa33e335340c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.759109] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dfdb816-cd83-46e7-9200-fa33e335340c',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.031942] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a34cfbc5-e3ce-4943-8058-702a82703915: rpc.has_security_group_logging(os_id): False [ 1082.050949] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.051137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.051196] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.051408] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.051527] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.051728] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.051846] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.051908] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.052102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.052180] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.052387] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.052484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.052543] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.052689] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.052761] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.052940] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.053035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.053117] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.053265] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.053340] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.053427] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 is going to be updated. [ 1082.116428] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.116593] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.116664] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.116867] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.117027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.132137] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: IN_PROGRESS for 2s [ 1082.264700] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff72da15-0579-4c17-8921-0de51b66ecbf taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.264700] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.264700] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff72da15-0579-4c17-8921-0de51b66ecbf',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.265609] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8dfdb816-cd83-46e7-9200-fa33e335340c with status ACTIVE [ 1082.265767] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.265871] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.266273] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.266520] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.266895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.266895] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.267059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.267170] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.267682] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.267682] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.267793] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.268257] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.268257] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.268257] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.268368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.268815] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8dfdb816-cd83-46e7-9200-fa33e335340c is going to be updated. [ 1082.299985] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.299985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.299985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.300251] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.300406] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.300680] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dfdb816-cd83-46e7-9200-fa33e335340c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.463818] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 in Status: SUCCESS [ 1082.463818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.463818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.464538] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.464763] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.464913] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.464980] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.465259] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.465259] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.465333] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.465468] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d5b6c61f-b9c6-44e9-934b-c9925befabf7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.771316] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff72da15-0579-4c17-8921-0de51b66ecbf',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.969042] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d5b6c61f-b9c6-44e9-934b-c9925befabf7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.273710] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.274100] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.274100] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.274347] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.274496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.274496] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff72da15-0579-4c17-8921-0de51b66ecbf is going to be created. [ 1083.312624] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.312821] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.312912] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.313195] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.313388] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.327556] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff72da15-0579-4c17-8921-0de51b66ecbf in Status: UNINITIALIZED for 2s [ 1083.392876] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de8176a8-b776-46da-b656-af62ce663e0d in Status: SUCCESS [ 1083.393061] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de8176a8-b776-46da-b656-af62ce663e0d deletion is rescheduled due to dependency. [ 1083.393491] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.471750] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d5b6c61f-b9c6-44e9-934b-c9925befabf7: rpc.has_security_group_logging(os_id): False [ 1083.491075] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.491075] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.491180] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.491357] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.491447] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.491680] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.491783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.491842] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.491988] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.492075] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.492168] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 is going to be created. [ 1083.559371] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.559522] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.559591] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.559797] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.561179] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.572731] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 in Status: IN_PROGRESS for 2s [ 1084.151575] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: SUCCESS [ 1084.151765] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.955881] env[65322]: INFO networking_nsxv3.common.synchronization [req-a40fc488-e9ed-4785-882e-31d564c9271c req-eec0b5e1-2060-43a5-8195-54fe62fb8d86 tempest-ServerRescueNegativeTestJSON-325476461 tempest-ServerRescueNegativeTestJSON-325476461-project-member] Enqueued Resource ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 with Priority: HIGHEST for action security_group_members [ 1084.957471] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 with Priority: HIGHEST for action security_group_members [ 1084.958436] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.958436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.959151] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.959151] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.959151] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.959151] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.959151] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.959381] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.959381] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.959439] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7bf5edc0-c1b5-489c-9093-35e6cf4bd266',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.338743] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff72da15-0579-4c17-8921-0de51b66ecbf in Status: SUCCESS [ 1085.338977] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.339167] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.339392] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.339589] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.339706] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.339771] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.339915] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.339990] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.340089] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.340180] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ff72da15-0579-4c17-8921-0de51b66ecbf',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.465793] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.466095] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.466239] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.466405] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.466515] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.466736] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.467053] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.467053] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.467134] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.467161] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.467233] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 is going to be updated. [ 1085.503165] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.503462] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.503462] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.504035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.504035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.514025] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 in Status: IN_PROGRESS for 2s [ 1085.592154] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 in Status: SUCCESS [ 1085.592204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.842355] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ff72da15-0579-4c17-8921-0de51b66ecbf',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.345366] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ff72da15-0579-4c17-8921-0de51b66ecbf: rpc.has_security_group_logging(os_id): False [ 1086.363152] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.363315] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.363383] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.363609] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.363704] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.363951] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.364073] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.364154] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.364313] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.364402] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.364615] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff72da15-0579-4c17-8921-0de51b66ecbf is going to be created. [ 1086.431233] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.431378] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.431459] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.431683] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.431885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.444961] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff72da15-0579-4c17-8921-0de51b66ecbf in Status: IN_PROGRESS for 2s [ 1087.537655] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 in Status: SUCCESS [ 1087.538081] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 deletion is rescheduled due to dependency. [ 1087.538081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.477169] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff72da15-0579-4c17-8921-0de51b66ecbf in Status: SUCCESS [ 1088.477460] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.912466] env[65322]: INFO networking_nsxv3.common.synchronization [req-c5022837-b57a-4059-9f8d-5654fc6f6b98 req-10d70207-011f-4a3c-b653-bb93e7668404 tempest-ServersNegativeTestJSON-1020115219 tempest-ServersNegativeTestJSON-1020115219-project-member] Enqueued Resource ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 with Priority: HIGHEST for action security_group_members [ 1088.912466] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 with Priority: HIGHEST for action security_group_members [ 1088.912466] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.912466] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.912466] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.916537] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.916892] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.917179] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.917359] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.917652] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.918036] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.918237] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.421440] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.421590] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.422189] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.422189] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.422189] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.422574] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.422574] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.422574] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.422860] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.422860] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.422860] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 is going to be updated. [ 1089.453791] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.453985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.454073] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.454605] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.454843] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.464235] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 in Status: IN_PROGRESS for 2s [ 1090.335948] env[65322]: INFO networking_nsxv3.common.synchronization [req-eb4b8710-272a-406e-a722-b2b2521fb9af req-b9a6537d-93a9-4b5b-baf0-04f563a7e005 tempest-ServerDiskConfigTestJSON-1167155511 tempest-ServerDiskConfigTestJSON-1167155511-project-member] Enqueued Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 1090.336579] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGHEST for action security_group_members [ 1090.336896] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.336992] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.337110] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.337246] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.337401] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.337500] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.337561] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.337700] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.337809] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.337900] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.843426] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.843426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.843426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.843426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.843426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.843426] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.843426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.843426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.843426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.843426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.843426] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 is going to be updated. [ 1090.870598] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.870968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.870968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.871085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.871147] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.882469] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: IN_PROGRESS for 2s [ 1091.475228] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 in Status: SUCCESS [ 1091.475604] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 deletion is rescheduled due to dependency. [ 1091.475710] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.115879] env[65322]: INFO networking_nsxv3.common.synchronization [req-0537f24c-e0c0-4d7e-bfc6-bf3a0f497638 req-c84f263a-d35a-455c-8333-b5220a73064f tempest-AttachInterfacesTestJSON-353803948 tempest-AttachInterfacesTestJSON-353803948-project-member] Enqueued Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 1092.119659] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 1092.119659] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.119659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.119659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.119659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.119659] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.119659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.119659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.119659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.119659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.119659] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.556172] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-896 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.556538] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.556613] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.557016] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.557326] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.557488] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.557603] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.557851] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.557992] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.558216] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1092.558318] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1092.558418] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1092.558520] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1092.558670] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1092.558744] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1092.558878] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1092.581849] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1092.581849] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1092.581849] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1092.581849] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.581849] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-7763361c-032c-46e7-ad5b-48b784a6bc84 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.581849] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-7763361c-032c-46e7-ad5b-48b784a6bc84" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.581849] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-7763361c-032c-46e7-ad5b-48b784a6bc84" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.581849] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-7763361c-032c-46e7-ad5b-48b784a6bc84" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.581849] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7763361c-032c-46e7-ad5b-48b784a6bc84',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.620744] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.620901] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.620971] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.621287] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.665446] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.665446] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.665446] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.665446] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.665446] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.665446] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.665446] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 is going to be updated. [ 1092.741084] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.741248] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.741328] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.741566] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.741753] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.755731] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: IN_PROGRESS for 2s [ 1092.894827] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a34cfbc5-e3ce-4943-8058-702a82703915 in Status: SUCCESS [ 1092.894827] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 deletion is rescheduled due to dependency. [ 1092.895052] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.087973] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.088190] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.088276] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.088567] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.088711] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.088861] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 7763361c-032c-46e7-ad5b-48b784a6bc84 not found, creating... [ 1093.089136] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.089289] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.089403] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.089625] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.089752] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.090038] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.090192] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.090306] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.090506] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.090651] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.090783] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 7763361c-032c-46e7-ad5b-48b784a6bc84 is going to be created. [ 1093.113617] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.113832] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.113954] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.114249] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.114477] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.114694] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-7763361c-032c-46e7-ad5b-48b784a6bc84" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.837638] env[65322]: INFO networking_nsxv3.common.synchronization [req-0537f24c-e0c0-4d7e-bfc6-bf3a0f497638 req-f6f8146f-fcb0-4398-9b12-73fb351a6940 service nova] Enqueued Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_rules [ 1093.837923] env[65322]: INFO networking_nsxv3.common.synchronization [req-0537f24c-e0c0-4d7e-bfc6-bf3a0f497638 req-f6f8146f-fcb0-4398-9b12-73fb351a6940 service nova] Enqueued Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 1093.838115] env[65322]: INFO networking_nsxv3.common.synchronization [req-0537f24c-e0c0-4d7e-bfc6-bf3a0f497638 req-f6f8146f-fcb0-4398-9b12-73fb351a6940 service nova] Enqueued Resource ID: 7763361c-032c-46e7-ad5b-48b784a6bc84 with Priority: HIGHEST for action port [ 1093.838593] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_rules [ 1093.838861] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 1093.839494] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7763361c-032c-46e7-ad5b-48b784a6bc84 with Priority: HIGHEST for action port [ 1093.839810] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.840030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.840063] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.840255] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.840367] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.841179] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.841273] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.841456] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-7763361c-032c-46e7-ad5b-48b784a6bc84 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.841580] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7763361c-032c-46e7-ad5b-48b784a6bc84" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.841680] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7763361c-032c-46e7-ad5b-48b784a6bc84" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.841887] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7763361c-032c-46e7-ad5b-48b784a6bc84" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.842060] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7763361c-032c-46e7-ad5b-48b784a6bc84',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.343948] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.344202] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.344483] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7763361c-032c-46e7-ad5b-48b784a6bc84 with status ACTIVE [ 1094.344743] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.344858] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.344959] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.346088] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.346088] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.346088] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.346088] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.346088] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.346343] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.346343] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.346573] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.346721] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.346796] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.347028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.347134] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.347250] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7763361c-032c-46e7-ad5b-48b784a6bc84 is going to be updated. [ 1094.381068] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.381220] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.381291] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.381499] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.381716] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.381958] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7763361c-032c-46e7-ad5b-48b784a6bc84" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.767495] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: SUCCESS [ 1094.767692] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 deletion is rescheduled due to dependency. [ 1094.767801] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.767993] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.768276] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.768446] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.768573] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.768636] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.768787] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.768880] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.768964] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.271473] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.650321] env[65322]: INFO networking_nsxv3.common.synchronization [req-e2c4a618-ea72-4d83-9210-2872a58c3cd3 req-5a447f36-40d5-4840-b5fc-131a1a94d603 tempest-ServerActionsTestOtherA-1162989957 tempest-ServerActionsTestOtherA-1162989957-project-member] Enqueued Resource ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 with Priority: HIGHEST for action security_group_members [ 1095.650977] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 with Priority: HIGHEST for action security_group_members [ 1095.651381] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.651504] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.651575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.652597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.652597] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.652597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.652597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.652597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.652597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.652857] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42a0bf4e-f927-429d-910f-f0fec4b5f3c8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.773951] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.016086] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-315 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.016086] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-315" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.016086] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-315" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.016471] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-315" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.016968] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.017385] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.017671] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.018073] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.018351] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.019014] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1096.019014] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1096.019014] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1096.019189] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1096.019282] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1096.019433] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1096.020030] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1096.042657] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1096.042875] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1096.043105] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1096.043399] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-315" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.043760] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-b89f3128-7373-45aa-8213-5d5eb96226b9 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.043991] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-b89f3128-7373-45aa-8213-5d5eb96226b9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.044223] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-b89f3128-7373-45aa-8213-5d5eb96226b9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.044541] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-b89f3128-7373-45aa-8213-5d5eb96226b9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.044714] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b89f3128-7373-45aa-8213-5d5eb96226b9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.155767] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.156017] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.156150] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.156388] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.156483] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.156697] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.156795] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.156857] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.157009] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.157091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.157180] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 is going to be deleted. [ 1096.189422] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.189634] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.189634] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.189831] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.189923] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.190033] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.277517] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.277989] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.277989] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.278113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.278187] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.278302] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 is going to be updated. [ 1096.331889] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.331889] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.331889] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.331889] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.331889] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.340962] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: IN_PROGRESS for 2s [ 1096.548752] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.548989] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.549135] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.549439] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.549594] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.549756] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port b89f3128-7373-45aa-8213-5d5eb96226b9 not found, creating... [ 1096.550318] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.550521] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.550678] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.551016] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.551199] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.551508] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.551747] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.551977] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.552282] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.552442] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.552611] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: b89f3128-7373-45aa-8213-5d5eb96226b9 is going to be created. [ 1096.584296] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.584575] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.584847] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.585304] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.585658] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.585961] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-b89f3128-7373-45aa-8213-5d5eb96226b9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.368279] env[65322]: INFO networking_nsxv3.common.synchronization [req-e2c4a618-ea72-4d83-9210-2872a58c3cd3 req-b3cc4528-c406-4d83-850e-f0bee1012122 service nova] Enqueued Resource ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 with Priority: HIGHEST for action security_group_rules [ 1097.368279] env[65322]: INFO networking_nsxv3.common.synchronization [req-e2c4a618-ea72-4d83-9210-2872a58c3cd3 req-b3cc4528-c406-4d83-850e-f0bee1012122 service nova] Enqueued Resource ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 with Priority: HIGHEST for action security_group_members [ 1097.368279] env[65322]: INFO networking_nsxv3.common.synchronization [req-e2c4a618-ea72-4d83-9210-2872a58c3cd3 req-b3cc4528-c406-4d83-850e-f0bee1012122 service nova] Enqueued Resource ID: b89f3128-7373-45aa-8213-5d5eb96226b9 with Priority: HIGHEST for action port [ 1097.368279] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 with Priority: HIGHEST for action security_group_rules [ 1097.368279] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 with Priority: HIGHEST for action security_group_members [ 1097.368957] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b89f3128-7373-45aa-8213-5d5eb96226b9 with Priority: HIGHEST for action port [ 1097.369484] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42a0bf4e-f927-429d-910f-f0fec4b5f3c8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.370169] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.370351] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.370688] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.370843] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42a0bf4e-f927-429d-910f-f0fec4b5f3c8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.372117] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.372731] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.372887] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.374331] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.376992] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.376992] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.377944] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.377944] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.377944] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.377944] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42a0bf4e-f927-429d-910f-f0fec4b5f3c8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.379310] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-b89f3128-7373-45aa-8213-5d5eb96226b9 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.379310] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b89f3128-7373-45aa-8213-5d5eb96226b9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.379310] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b89f3128-7373-45aa-8213-5d5eb96226b9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.379310] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b89f3128-7373-45aa-8213-5d5eb96226b9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.379545] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b89f3128-7373-45aa-8213-5d5eb96226b9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.881944] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('42a0bf4e-f927-429d-910f-f0fec4b5f3c8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.884290] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.884290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.884290] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b89f3128-7373-45aa-8213-5d5eb96226b9 with status ACTIVE [ 1097.884543] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.884603] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.884652] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.884925] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.885056] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.885284] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.885410] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.885510] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.885996] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.885996] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.886192] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.886192] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.886300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.886427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.886527] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.886643] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b89f3128-7373-45aa-8213-5d5eb96226b9 is going to be updated. [ 1097.913789] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.913789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.913789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.913789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.914032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.914032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b89f3128-7373-45aa-8213-5d5eb96226b9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.351270] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: SUCCESS [ 1098.351510] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.351675] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.351882] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.352113] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.352244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.352327] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.352466] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.352547] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.352644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.352799] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.384661] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('42a0bf4e-f927-429d-910f-f0fec4b5f3c8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.856072] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.856072] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.856072] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.856072] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.856072] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.856072] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.856072] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.856072] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.856072] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.856072] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.857192] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.857192] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.857192] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.857192] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.857192] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.857192] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.857192] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.857192] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.857192] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.857192] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.857549] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.887728] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.887728] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.887899] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.888011] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.888196] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.888196] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 is going to be created. [ 1098.921022] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.921022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.921022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.921022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.921022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.932326] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 in Status: UNINITIALIZED for 2s [ 1099.361409] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06de8ea8-08fd-4206-a96b-fafa1c856867: rpc.has_security_group_logging(os_id): False [ 1099.394771] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.394771] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.394771] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.395227] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.395227] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.395227] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.395333] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.395366] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.397425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.397425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.397425] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.397425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.397425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.397425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.397425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.397425] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.397425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.397425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.397425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.397425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.397425] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 is going to be updated. [ 1099.497071] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.497071] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.497071] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.497071] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.497071] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.519850] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: IN_PROGRESS for 2s [ 1099.899780] env[65322]: INFO networking_nsxv3.common.synchronization [None req-64755aea-13a7-4e06-8faf-6722afbacd51 tempest-AttachInterfacesTestJSON-353803948 tempest-AttachInterfacesTestJSON-353803948-project-member] Enqueued Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 1099.900423] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 1099.901066] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.901199] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.901199] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.901366] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.901518] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.901610] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.901788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.901952] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.902055] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.902151] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.138871] env[65322]: INFO networking_nsxv3.common.synchronization [req-12854d01-ae3f-492e-9f21-f8494ac6b71f req-d0211c9d-71db-4731-8c20-d85240fb5696 tempest-DeleteServersTestJSON-1463403857 tempest-DeleteServersTestJSON-1463403857-project-member] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 1100.139445] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 1100.139759] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.139882] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.140332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.140332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.140332] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.140529] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.140529] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.140971] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.140971] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.140971] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.404719] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.565647] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.565871] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.566013] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.566299] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.566562] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.567912] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.568111] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.568378] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.569262] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.569496] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1100.569604] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1100.569713] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1100.569823] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1100.569930] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1100.570047] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1100.570182] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1100.610040] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1100.610314] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1100.610551] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1100.610728] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.611743] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-b3d5e5b4-b710-4701-bc25-58e7933bb3c1 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.611743] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-b3d5e5b4-b710-4701-bc25-58e7933bb3c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.611743] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-b3d5e5b4-b710-4701-bc25-58e7933bb3c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.611743] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-b3d5e5b4-b710-4701-bc25-58e7933bb3c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.612106] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3d5e5b4-b710-4701-bc25-58e7933bb3c1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.643980] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.644173] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.644213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.644417] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.644504] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.644700] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.644802] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.644862] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.645028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.645109] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.645197] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be updated. [ 1100.731251] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.731455] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.731455] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.731614] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.731767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.758571] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: IN_PROGRESS for 2s [ 1100.906993] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.944615] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 in Status: SUCCESS [ 1100.944894] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.945112] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.945354] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.945575] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.945729] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.945893] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.945992] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.946040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.946133] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.946221] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('42a0bf4e-f927-429d-910f-f0fec4b5f3c8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.114236] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.114971] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.114971] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.115165] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.115316] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.115474] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port b3d5e5b4-b710-4701-bc25-58e7933bb3c1 not found, creating... [ 1101.115817] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.115973] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.116098] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.116331] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.116469] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.116855] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.117415] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.117415] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.117642] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.117642] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.117828] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: b3d5e5b4-b710-4701-bc25-58e7933bb3c1 is going to be created. [ 1101.145492] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.145773] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.145942] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.146168] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.146402] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.146621] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-b3d5e5b4-b710-4701-bc25-58e7933bb3c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.409246] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.409571] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.409571] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.409691] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.409779] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.409938] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 is going to be updated. [ 1101.447248] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.447495] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.447495] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.447963] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.448123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.450103] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.450274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.450402] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.450719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.451802] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.451802] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.451802] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.451802] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.451802] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.452085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.452180] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.452373] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.452564] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.453099] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.453351] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.453561] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.453714] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.453985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.454166] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.454343] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.454515] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('42a0bf4e-f927-429d-910f-f0fec4b5f3c8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.466593] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: IN_PROGRESS for 2s [ 1101.551405] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: SUCCESS [ 1101.551633] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.844145] env[65322]: INFO networking_nsxv3.common.synchronization [req-12854d01-ae3f-492e-9f21-f8494ac6b71f req-bb20ed7f-3051-49b6-9754-1d8698f9032d service nova] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_rules [ 1101.844344] env[65322]: INFO networking_nsxv3.common.synchronization [req-12854d01-ae3f-492e-9f21-f8494ac6b71f req-bb20ed7f-3051-49b6-9754-1d8698f9032d service nova] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 1101.844475] env[65322]: INFO networking_nsxv3.common.synchronization [req-12854d01-ae3f-492e-9f21-f8494ac6b71f req-bb20ed7f-3051-49b6-9754-1d8698f9032d service nova] Enqueued Resource ID: b3d5e5b4-b710-4701-bc25-58e7933bb3c1 with Priority: HIGHEST for action port [ 1101.845190] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_rules [ 1101.845355] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 1101.845455] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3d5e5b4-b710-4701-bc25-58e7933bb3c1 with Priority: HIGHEST for action port [ 1101.845942] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.846149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.846218] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.846501] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.846768] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.848918] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.849054] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.849336] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3d5e5b4-b710-4701-bc25-58e7933bb3c1 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.849498] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3d5e5b4-b710-4701-bc25-58e7933bb3c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.849585] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3d5e5b4-b710-4701-bc25-58e7933bb3c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.849889] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3d5e5b4-b710-4701-bc25-58e7933bb3c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.849966] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3d5e5b4-b710-4701-bc25-58e7933bb3c1',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.958284] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 42a0bf4e-f927-429d-910f-f0fec4b5f3c8: rpc.has_security_group_logging(os_id): False [ 1101.978077] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.978243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.978304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.978511] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.978602] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.978797] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.978894] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.978953] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.979117] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.979191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.979376] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.979495] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.979526] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.979789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.979789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.979992] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.980134] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.980209] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.980394] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.980491] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.980595] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 is going to be created. [ 1102.064719] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.064957] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.064957] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.065218] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.065318] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.084972] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 in Status: IN_PROGRESS for 2s [ 1102.344779] env[65322]: INFO networking_nsxv3.common.synchronization [None req-9d47ff6d-9226-4c66-a4de-799db1c1513e tempest-AttachVolumeNegativeTest-885508175 tempest-AttachVolumeNegativeTest-885508175-project-member] Enqueued Resource ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac with Priority: HIGHEST for action security_group_rules [ 1102.346822] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac with Priority: HIGHEST for action security_group_rules [ 1102.347409] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-102dbac2-73ae-49a6-b7c8-8cf31712d5ac taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.347471] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.347573] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.347936] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.348077] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('102dbac2-73ae-49a6-b7c8-8cf31712d5ac',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.350846] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.351160] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.352333] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3d5e5b4-b710-4701-bc25-58e7933bb3c1 with status ACTIVE [ 1102.352592] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.352742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.352822] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.353088] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.353181] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.353386] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.353515] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.353717] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.353938] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.354067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.354330] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.354458] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.354566] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.354789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.354928] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.354985] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3d5e5b4-b710-4701-bc25-58e7933bb3c1 is going to be updated. [ 1102.415040] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.415040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.415040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.415740] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.416015] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.416872] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3d5e5b4-b710-4701-bc25-58e7933bb3c1" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.446040] env[65322]: INFO networking_nsxv3.common.synchronization [None req-47a1f6d9-4e9d-4b4f-8c3a-b287cab781a8 tempest-AttachVolumeNegativeTest-885508175 tempest-AttachVolumeNegativeTest-885508175-project-member] Enqueued Resource ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac with Priority: HIGHEST for action security_group_rules [ 1102.447714] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac with Priority: HIGHEST for action security_group_rules [ 1102.447714] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-102dbac2-73ae-49a6-b7c8-8cf31712d5ac taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.447714] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.750845] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-896 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.751059] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.751183] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.751461] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.751721] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.751879] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.751993] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.752240] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.752378] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.752584] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1102.752692] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1102.752896] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1102.752896] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1102.752993] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1102.753108] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1102.753236] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1102.771921] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: SUCCESS [ 1102.772141] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 deletion is rescheduled due to dependency. [ 1102.772262] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.772419] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.772620] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.772800] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.772912] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.772976] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.773145] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.773225] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.773318] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.780944] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1102.781129] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1102.781268] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1102.781443] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.781788] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-bcbbfc13-f2e3-4198-8b43-be18dbf29b9c taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.781977] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-bcbbfc13-f2e3-4198-8b43-be18dbf29b9c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.782124] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-bcbbfc13-f2e3-4198-8b43-be18dbf29b9c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.782495] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-bcbbfc13-f2e3-4198-8b43-be18dbf29b9c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.782610] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcbbfc13-f2e3-4198-8b43-be18dbf29b9c',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.876381] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.876613] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.876728] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.877077] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.877239] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.877399] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac already deleted. [ 1102.877533] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.877772] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.878055] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.878181] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('102dbac2-73ae-49a6-b7c8-8cf31712d5ac',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.276220] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.285515] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.285951] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.286219] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.286653] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.286933] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.287226] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port bcbbfc13-f2e3-4198-8b43-be18dbf29b9c not found, creating... [ 1103.287787] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.288090] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.288289] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.288676] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.288882] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.289368] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.289597] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.289766] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.290125] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.290505] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.290605] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: bcbbfc13-f2e3-4198-8b43-be18dbf29b9c is going to be created. [ 1103.319222] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.319525] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.319589] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.319853] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.320100] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.320334] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-bcbbfc13-f2e3-4198-8b43-be18dbf29b9c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.401274] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.401486] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.401563] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.401784] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.401875] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.401979] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac already deleted. [ 1103.402181] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.481817] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: SUCCESS [ 1103.482304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.781724] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.040942] env[65322]: INFO networking_nsxv3.common.synchronization [req-a29c0b39-16b0-415c-aad3-dab884bcf1c9 req-367c278b-428a-4c51-bfe7-bbbc7448c938 service nova] Enqueued Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_rules [ 1104.041145] env[65322]: INFO networking_nsxv3.common.synchronization [req-a29c0b39-16b0-415c-aad3-dab884bcf1c9 req-367c278b-428a-4c51-bfe7-bbbc7448c938 service nova] Enqueued Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 1104.041279] env[65322]: INFO networking_nsxv3.common.synchronization [req-a29c0b39-16b0-415c-aad3-dab884bcf1c9 req-367c278b-428a-4c51-bfe7-bbbc7448c938 service nova] Enqueued Resource ID: bcbbfc13-f2e3-4198-8b43-be18dbf29b9c with Priority: HIGHEST for action port [ 1104.041866] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_rules [ 1104.042016] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 1104.042726] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcbbfc13-f2e3-4198-8b43-be18dbf29b9c with Priority: HIGHEST for action port [ 1104.043303] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.043303] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.043303] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.043526] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.043572] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.045869] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.046035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.046106] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.046347] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.046567] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.046660] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.046788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.046847] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.046910] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.047023] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.048409] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcbbfc13-f2e3-4198-8b43-be18dbf29b9c taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.048554] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcbbfc13-f2e3-4198-8b43-be18dbf29b9c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.049420] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcbbfc13-f2e3-4198-8b43-be18dbf29b9c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.050423] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcbbfc13-f2e3-4198-8b43-be18dbf29b9c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.050423] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcbbfc13-f2e3-4198-8b43-be18dbf29b9c',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.117289] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 in Status: SUCCESS [ 1104.117289] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.284311] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.284459] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.284535] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.284776] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.284867] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.285102] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be updated. [ 1104.326521] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.326720] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.326759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.327277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.327277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.338219] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: IN_PROGRESS for 2s [ 1104.546564] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.546914] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.553190] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.554385] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcbbfc13-f2e3-4198-8b43-be18dbf29b9c with status ACTIVE [ 1104.554624] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.554785] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.554866] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.555067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.555592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.555592] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.555592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.555592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.556047] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.556047] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.556754] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.556754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.556754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.556754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.556754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.557406] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcbbfc13-f2e3-4198-8b43-be18dbf29b9c is going to be updated. [ 1104.593374] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.593374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.593545] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.593796] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.593986] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.594269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcbbfc13-f2e3-4198-8b43-be18dbf29b9c" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.059541] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.564388] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.564388] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.564388] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.564388] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.564388] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.564388] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 is going to be updated. [ 1105.591409] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.593405] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.593405] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.593405] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.593405] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.602571] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: IN_PROGRESS for 2s [ 1106.364784] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: SUCCESS [ 1106.364784] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.364784] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.364784] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.364784] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.365322] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.365322] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.365322] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.365322] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.365509] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.365509] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.869715] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.870030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.870030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.870404] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.870590] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.870695] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.870760] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.870908] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.870993] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.871094] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.871232] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.871322] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.871379] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.871535] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.871670] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.871761] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.871823] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.872010] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.872082] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.872253] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.872253] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.376316] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e863a544-814a-4bca-b4b1-35f9a61afcd3: rpc.has_security_group_logging(os_id): False [ 1107.396406] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.396561] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.396989] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.397405] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.397521] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.399450] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.399450] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.399450] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.399450] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.399450] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.399450] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.399450] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.399450] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.399450] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.399450] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.399966] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.399966] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.399966] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.400198] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.400246] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.400312] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be updated. [ 1107.434253] env[65322]: INFO networking_nsxv3.common.synchronization [req-effe8789-3dd1-43d0-bfdf-d954c4aed92a req-9909c293-6e3c-4e69-870a-36cad32366db tempest-ServerActionsTestOtherA-1162989957 tempest-ServerActionsTestOtherA-1162989957-project-member] Enqueued Resource ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 with Priority: HIGHEST for action security_group_members [ 1107.435089] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 with Priority: HIGHEST for action security_group_members [ 1107.435417] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.435626] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.435626] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.435996] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.438233] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.438396] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.438462] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.438678] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.438778] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.438850] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('42a0bf4e-f927-429d-910f-f0fec4b5f3c8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.499117] env[65322]: INFO networking_nsxv3.common.synchronization [req-effe8789-3dd1-43d0-bfdf-d954c4aed92a req-9909c293-6e3c-4e69-870a-36cad32366db tempest-ServerActionsTestOtherA-1162989957 tempest-ServerActionsTestOtherA-1162989957-project-member] Enqueued Resource ID: b89f3128-7373-45aa-8213-5d5eb96226b9 with Priority: HIGHEST for action port [ 1107.499820] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b89f3128-7373-45aa-8213-5d5eb96226b9 with Priority: HIGHEST for action port [ 1107.500261] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-b89f3128-7373-45aa-8213-5d5eb96226b9 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.500395] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b89f3128-7373-45aa-8213-5d5eb96226b9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.500456] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b89f3128-7373-45aa-8213-5d5eb96226b9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.500669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b89f3128-7373-45aa-8213-5d5eb96226b9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.500745] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b89f3128-7373-45aa-8213-5d5eb96226b9',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.584234] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.584534] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.584534] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.584769] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.584933] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.611123] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: IN_PROGRESS for 2s [ 1107.615412] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: SUCCESS [ 1107.615602] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.615838] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.616085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.616314] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.616411] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.616477] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.616656] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.616747] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.616831] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.616920] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.941386] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.942407] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.942407] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.942407] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.942407] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.942407] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.942407] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.942407] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.942628] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.942628] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.942628] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 is going to be updated. [ 1107.975872] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.976138] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.976236] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.976704] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.976967] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.990024] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 in Status: IN_PROGRESS for 2s [ 1108.006249] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b89f3128-7373-45aa-8213-5d5eb96226b9 with status ACTIVE [ 1108.006249] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.006249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.006249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.006249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.006249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.006249] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.006249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.006249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.006249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.006249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.006249] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.006678] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.006678] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.006678] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.006678] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.006678] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b89f3128-7373-45aa-8213-5d5eb96226b9 is going to be updated. [ 1108.033251] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.033251] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.033251] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.033646] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.033646] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.033646] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b89f3128-7373-45aa-8213-5d5eb96226b9" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.122388] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.122612] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.122612] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.122939] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.122999] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.123110] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.123175] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.123327] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.123412] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.123500] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.123679] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.123786] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.123848] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.123989] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.124141] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.124231] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.124290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.124426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.124502] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.124581] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.124670] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.628655] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06de8ea8-08fd-4206-a96b-fafa1c856867: rpc.has_security_group_logging(os_id): False [ 1108.651076] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.651076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.651076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.651076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.651076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.651076] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.651076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.651076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.651076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.651076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.651076] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.651076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.651076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.651076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.651076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.651819] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.652081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.652340] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.654762] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.654762] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.654762] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 is going to be updated. [ 1108.730508] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.730508] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.730508] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.730508] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.730508] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.764502] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: IN_PROGRESS for 2s [ 1108.855314] env[65322]: INFO networking_nsxv3.common.synchronization [req-dfdebc2a-9576-4542-b9fc-b5b4a4c1081f req-79295fc0-5524-4fe2-b668-21b7649167c3 tempest-ImagesOneServerTestJSON-1587877163 tempest-ImagesOneServerTestJSON-1587877163-project-member] Enqueued Resource ID: 13d294c9-5967-4aff-b987-840ca5e2ead4 with Priority: HIGHEST for action security_group_members [ 1108.855314] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13d294c9-5967-4aff-b987-840ca5e2ead4 with Priority: HIGHEST for action security_group_members [ 1108.856077] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-13d294c9-5967-4aff-b987-840ca5e2ead4 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.856481] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.856717] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.858796] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.859193] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.859495] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.861622] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.861622] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.861622] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.861622] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('13d294c9-5967-4aff-b987-840ca5e2ead4',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.362765] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.363067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.363067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.363658] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.363658] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.363658] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.363658] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.363868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.363868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.363931] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.364332] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13d294c9-5967-4aff-b987-840ca5e2ead4 is going to be updated. [ 1109.396298] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.396428] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.396495] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.396724] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.396882] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.407957] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13d294c9-5967-4aff-b987-840ca5e2ead4 in Status: IN_PROGRESS for 2s [ 1109.632044] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: SUCCESS [ 1109.632455] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.003153] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 in Status: SUCCESS [ 1110.003153] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 deletion is rescheduled due to dependency. [ 1110.003153] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.680349] env[65322]: INFO networking_nsxv3.common.synchronization [None req-693d8186-a276-4fb0-bc65-b0fc949dd087 None None] Enqueued Resource ID: 62dc95e1-b1b6-4ff5-8c8a-050de9450d43 with Priority: HIGHEST for action port [ 1110.680349] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62dc95e1-b1b6-4ff5-8c8a-050de9450d43 with Priority: HIGHEST for action port [ 1110.680349] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-62dc95e1-b1b6-4ff5-8c8a-050de9450d43 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.680349] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62dc95e1-b1b6-4ff5-8c8a-050de9450d43" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.680349] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62dc95e1-b1b6-4ff5-8c8a-050de9450d43" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.681214] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62dc95e1-b1b6-4ff5-8c8a-050de9450d43" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.681383] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62dc95e1-b1b6-4ff5-8c8a-050de9450d43',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.809113] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: SUCCESS [ 1110.809453] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.185872] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62dc95e1-b1b6-4ff5-8c8a-050de9450d43 [ 1111.186144] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.186286] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.186360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.186732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.186816] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.186863] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62dc95e1-b1b6-4ff5-8c8a-050de9450d43 already deleted. [ 1111.186946] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62dc95e1-b1b6-4ff5-8c8a-050de9450d43" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.420958] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 13d294c9-5967-4aff-b987-840ca5e2ead4 in Status: SUCCESS [ 1111.420958] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 13d294c9-5967-4aff-b987-840ca5e2ead4 deletion is rescheduled due to dependency. [ 1111.420958] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-13d294c9-5967-4aff-b987-840ca5e2ead4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.549692] env[65322]: INFO networking_nsxv3.common.synchronization [req-5b102750-5a9e-46b0-a20c-9b67f256336e req-7347166c-86fe-4292-bf60-3212f167b313 tempest-AttachVolumeNegativeTest-885508175 tempest-AttachVolumeNegativeTest-885508175-project-member] Enqueued Resource ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac with Priority: HIGHEST for action security_group_members [ 1112.550383] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac with Priority: HIGHEST for action security_group_members [ 1112.550739] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-102dbac2-73ae-49a6-b7c8-8cf31712d5ac taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.550883] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.551326] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.551645] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.553114] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.553114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.553114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.553114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.553114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.553114] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('102dbac2-73ae-49a6-b7c8-8cf31712d5ac',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.940224] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-318 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.940411] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-318" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.940523] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-318" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.940827] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-318" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.941149] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.941323] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.941436] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.941668] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.941811] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.942024] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1112.942155] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1112.942263] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1112.942366] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1112.942470] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1112.942572] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1112.942701] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1112.963892] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1112.964130] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1112.964269] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1112.964443] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-318" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.964767] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-975ff999-66aa-46a2-930a-32bdc78b0699 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.964936] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-975ff999-66aa-46a2-930a-32bdc78b0699" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.965064] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-975ff999-66aa-46a2-930a-32bdc78b0699" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.965485] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-975ff999-66aa-46a2-930a-32bdc78b0699" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.965640] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('975ff999-66aa-46a2-930a-32bdc78b0699',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.032528] env[65322]: INFO networking_nsxv3.common.synchronization [None req-0e81ff8e-9223-4496-b115-b300c17d86c5 None None] Enqueued Resource ID: bebbdfd2-373f-4b53-950d-99c133f2020b with Priority: HIGHEST for action port [ 1113.033072] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bebbdfd2-373f-4b53-950d-99c133f2020b with Priority: HIGHEST for action port [ 1113.033440] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-bebbdfd2-373f-4b53-950d-99c133f2020b taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.033589] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bebbdfd2-373f-4b53-950d-99c133f2020b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.033589] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bebbdfd2-373f-4b53-950d-99c133f2020b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.033851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bebbdfd2-373f-4b53-950d-99c133f2020b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.033973] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bebbdfd2-373f-4b53-950d-99c133f2020b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.056769] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.058905] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.058905] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.058905] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.058905] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.058905] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.058905] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.058905] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.058905] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.058905] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.058905] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac already deleted. [ 1113.058905] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.470056] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.470056] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.470056] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.470056] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.470056] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.470648] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 975ff999-66aa-46a2-930a-32bdc78b0699 not found, creating... [ 1113.470648] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.470648] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.470648] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.470862] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.470994] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.471278] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.471428] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.471541] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.471747] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.471989] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.472168] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 975ff999-66aa-46a2-930a-32bdc78b0699 is going to be created. [ 1113.495710] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.495994] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.496157] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.496447] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.496750] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.496966] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-975ff999-66aa-46a2-930a-32bdc78b0699" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.536529] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bebbdfd2-373f-4b53-950d-99c133f2020b [ 1113.536661] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.536727] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.537610] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.537610] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.537610] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.537610] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bebbdfd2-373f-4b53-950d-99c133f2020b already deleted. [ 1113.537610] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bebbdfd2-373f-4b53-950d-99c133f2020b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.236409] env[65322]: INFO networking_nsxv3.common.synchronization [req-5b102750-5a9e-46b0-a20c-9b67f256336e req-ab9f7fb1-d2d5-481b-91c1-c5dec7e2acb1 service nova] Enqueued Resource ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac with Priority: HIGHEST for action security_group_rules [ 1114.236409] env[65322]: INFO networking_nsxv3.common.synchronization [req-5b102750-5a9e-46b0-a20c-9b67f256336e req-ab9f7fb1-d2d5-481b-91c1-c5dec7e2acb1 service nova] Enqueued Resource ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac with Priority: HIGHEST for action security_group_members [ 1114.236409] env[65322]: INFO networking_nsxv3.common.synchronization [req-5b102750-5a9e-46b0-a20c-9b67f256336e req-ab9f7fb1-d2d5-481b-91c1-c5dec7e2acb1 service nova] Enqueued Resource ID: 975ff999-66aa-46a2-930a-32bdc78b0699 with Priority: HIGHEST for action port [ 1114.236409] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac with Priority: HIGHEST for action security_group_rules [ 1114.236409] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac with Priority: HIGHEST for action security_group_members [ 1114.236942] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 975ff999-66aa-46a2-930a-32bdc78b0699 with Priority: HIGHEST for action port [ 1114.237509] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-102dbac2-73ae-49a6-b7c8-8cf31712d5ac taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.237902] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.238112] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.239061] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.239061] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('102dbac2-73ae-49a6-b7c8-8cf31712d5ac',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.239550] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-102dbac2-73ae-49a6-b7c8-8cf31712d5ac taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.239732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.239832] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.240084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.240277] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.240406] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.240496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.240681] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.240801] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.240925] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('102dbac2-73ae-49a6-b7c8-8cf31712d5ac',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.242353] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-975ff999-66aa-46a2-930a-32bdc78b0699 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.242569] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-975ff999-66aa-46a2-930a-32bdc78b0699" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.243682] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-975ff999-66aa-46a2-930a-32bdc78b0699" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.243831] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-975ff999-66aa-46a2-930a-32bdc78b0699" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.243918] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('975ff999-66aa-46a2-930a-32bdc78b0699',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.747086] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-102dbac2-73ae-49a6-b7c8-8cf31712d5ac taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.747086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.747385] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('102dbac2-73ae-49a6-b7c8-8cf31712d5ac',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.748296] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 975ff999-66aa-46a2-930a-32bdc78b0699 with status ACTIVE [ 1114.748386] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.748473] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.749118] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.749118] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.749118] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.749118] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.749118] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.749118] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.749376] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.749376] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.749498] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.750330] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.750330] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.750330] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.750330] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.750330] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 975ff999-66aa-46a2-930a-32bdc78b0699 is going to be updated. [ 1114.776365] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.776549] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.776596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.776935] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.777024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.777219] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-975ff999-66aa-46a2-930a-32bdc78b0699" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.828189] env[65322]: INFO networking_nsxv3.common.synchronization [req-cfa75a63-6a49-4798-9bd0-c5bd6335851f req-79a688d7-5927-4dc0-84d6-f4ba5f8598d1 tempest-DeleteServersTestJSON-1463403857 tempest-DeleteServersTestJSON-1463403857-project-member] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 1114.828776] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 1114.829331] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.829458] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.829528] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.830213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.830213] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.830213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.830213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.830429] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.830429] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.830491] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.253653] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('102dbac2-73ae-49a6-b7c8-8cf31712d5ac',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.333211] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.333447] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.333447] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.333648] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.333724] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.334304] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.334304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.334304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.334304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.334304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.334617] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be updated. [ 1115.369652] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.369652] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.369652] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.369928] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.370998] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.381705] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: IN_PROGRESS for 2s [ 1115.756180] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.756383] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.756513] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.756766] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.756862] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.756969] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac is going to be created. [ 1115.792247] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.792426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.792463] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.792686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.792864] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.809204] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac in Status: UNINITIALIZED for 2s [ 1117.399353] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: SUCCESS [ 1117.399353] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 deletion is rescheduled due to dependency. [ 1117.399353] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.449795] env[65322]: INFO networking_nsxv3.common.synchronization [req-b55b213d-f799-4904-8134-6a7f35ab7c7a req-b22f8d51-4aba-4afa-843a-499b86cc7afc tempest-AttachInterfacesTestJSON-353803948 tempest-AttachInterfacesTestJSON-353803948-project-member] Enqueued Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 1117.450381] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 1117.452376] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.452573] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.455010] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.455010] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.455010] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.455010] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.455010] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.455010] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.455010] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.455010] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.829027] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac in Status: SUCCESS [ 1117.829326] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.829529] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.829774] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.829971] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.830137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.830198] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.830371] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.830443] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.830536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.830630] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('102dbac2-73ae-49a6-b7c8-8cf31712d5ac',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.955733] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.171741] env[65322]: INFO networking_nsxv3.common.synchronization [None req-9ee17ca1-2736-431e-a3ec-1f8fe55d49b1 tempest-AttachInterfacesTestJSON-353803948 tempest-AttachInterfacesTestJSON-353803948-project-member] Enqueued Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 1118.172568] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 1118.173052] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.173318] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.333221] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('102dbac2-73ae-49a6-b7c8-8cf31712d5ac',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.462875] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.679335] env[65322]: INFO networking_nsxv3.common.synchronization [req-650d88ac-bcdc-44c8-8941-2ac61d98653c req-1df4d932-8a26-4cc2-9481-4c391a2db21b tempest-ServerPasswordTestJSON-92536925 tempest-ServerPasswordTestJSON-92536925-project-member] Enqueued Resource ID: ad4a2118-b75b-4683-89be-e12ef55e1faa with Priority: HIGHEST for action security_group_members [ 1118.679335] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad4a2118-b75b-4683-89be-e12ef55e1faa with Priority: HIGHEST for action security_group_members [ 1118.679335] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad4a2118-b75b-4683-89be-e12ef55e1faa taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.679696] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.680031] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.680412] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.680723] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.683846] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.683846] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.683846] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.683846] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.683846] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad4a2118-b75b-4683-89be-e12ef55e1faa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.836165] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 102dbac2-73ae-49a6-b7c8-8cf31712d5ac: rpc.has_security_group_logging(os_id): False [ 1118.857896] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.857896] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.857896] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.857896] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.857896] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.857896] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.857896] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.857896] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.857896] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.857896] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.857896] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac is going to be created. [ 1118.920250] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.920806] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.920929] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.921462] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.921675] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.937756] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac in Status: IN_PROGRESS for 2s [ 1118.966553] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.966732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.966819] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.967245] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.967400] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.967514] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 is going to be updated. [ 1119.042944] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.043181] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.043181] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.043475] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.043549] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.057979] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: IN_PROGRESS for 2s [ 1119.066150] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-790 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.066337] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-790" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.066457] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-790" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.066811] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-790" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.067289] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.067474] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.067590] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.067826] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.067965] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.068221] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1119.068334] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1119.068444] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1119.068550] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1119.068660] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1119.068791] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1119.068927] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1119.089524] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1119.089782] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1119.089983] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1119.090232] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-790" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.090600] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-1df10a84-7a2a-4530-bf96-d7e1b87b3f80 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.090897] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-1df10a84-7a2a-4530-bf96-d7e1b87b3f80" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.091057] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-1df10a84-7a2a-4530-bf96-d7e1b87b3f80" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.091390] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-1df10a84-7a2a-4530-bf96-d7e1b87b3f80" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.091527] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1df10a84-7a2a-4530-bf96-d7e1b87b3f80',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.185940] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.187644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.187644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.187644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.187644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.187644] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.187644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.187644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.187644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.187644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.187644] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad4a2118-b75b-4683-89be-e12ef55e1faa already deleted. [ 1119.187644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.595134] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.595502] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.595502] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.595770] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.595954] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.596136] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 1df10a84-7a2a-4530-bf96-d7e1b87b3f80 not found, creating... [ 1119.596399] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.596554] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.596666] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.596898] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.597050] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.597461] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.597715] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.597906] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.598241] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.598453] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.598612] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 1df10a84-7a2a-4530-bf96-d7e1b87b3f80 is going to be created. [ 1119.627212] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.627415] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.627537] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.627809] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.628044] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.628296] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-1df10a84-7a2a-4530-bf96-d7e1b87b3f80" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.338379] env[65322]: INFO networking_nsxv3.common.synchronization [None req-c48511bb-9a4a-4fb0-b1c9-5d8e07bfb309 None None] Enqueued Resource ID: 03ba75eb-0083-4cd8-8b11-51faa2bd0718 with Priority: HIGHEST for action port [ 1120.338379] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03ba75eb-0083-4cd8-8b11-51faa2bd0718 with Priority: HIGHEST for action port [ 1120.338761] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-03ba75eb-0083-4cd8-8b11-51faa2bd0718 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.338761] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03ba75eb-0083-4cd8-8b11-51faa2bd0718" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.338761] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03ba75eb-0083-4cd8-8b11-51faa2bd0718" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.339013] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03ba75eb-0083-4cd8-8b11-51faa2bd0718" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.339073] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03ba75eb-0083-4cd8-8b11-51faa2bd0718',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.383469] env[65322]: INFO networking_nsxv3.common.synchronization [req-650d88ac-bcdc-44c8-8941-2ac61d98653c req-78b5561d-a14f-4e52-a0a6-2e1768dfa3cf service nova] Enqueued Resource ID: ad4a2118-b75b-4683-89be-e12ef55e1faa with Priority: HIGHEST for action security_group_rules [ 1120.383649] env[65322]: INFO networking_nsxv3.common.synchronization [req-650d88ac-bcdc-44c8-8941-2ac61d98653c req-78b5561d-a14f-4e52-a0a6-2e1768dfa3cf service nova] Enqueued Resource ID: ad4a2118-b75b-4683-89be-e12ef55e1faa with Priority: HIGHEST for action security_group_members [ 1120.383884] env[65322]: INFO networking_nsxv3.common.synchronization [req-650d88ac-bcdc-44c8-8941-2ac61d98653c req-78b5561d-a14f-4e52-a0a6-2e1768dfa3cf service nova] Enqueued Resource ID: 1df10a84-7a2a-4530-bf96-d7e1b87b3f80 with Priority: HIGHEST for action port [ 1120.384646] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad4a2118-b75b-4683-89be-e12ef55e1faa with Priority: HIGHEST for action security_group_rules [ 1120.384646] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad4a2118-b75b-4683-89be-e12ef55e1faa with Priority: HIGHEST for action security_group_members [ 1120.384740] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1df10a84-7a2a-4530-bf96-d7e1b87b3f80 with Priority: HIGHEST for action port [ 1120.385019] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad4a2118-b75b-4683-89be-e12ef55e1faa taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.385149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.385201] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.385479] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.385559] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad4a2118-b75b-4683-89be-e12ef55e1faa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.386722] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad4a2118-b75b-4683-89be-e12ef55e1faa taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.386722] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.386722] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.386881] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.387020] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.387138] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.387395] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.387395] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.387395] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.387537] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad4a2118-b75b-4683-89be-e12ef55e1faa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.388356] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-1df10a84-7a2a-4530-bf96-d7e1b87b3f80 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.388465] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1df10a84-7a2a-4530-bf96-d7e1b87b3f80" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.389133] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1df10a84-7a2a-4530-bf96-d7e1b87b3f80" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.389133] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1df10a84-7a2a-4530-bf96-d7e1b87b3f80" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.389133] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1df10a84-7a2a-4530-bf96-d7e1b87b3f80',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.807420] env[65322]: INFO networking_nsxv3.common.synchronization [req-0cb364b4-d82c-4825-81c3-9de8bd587ad9 req-0c49e10e-03c6-4b9b-ad23-800d9acab411 tempest-ServerActionsTestOtherB-30032286 tempest-ServerActionsTestOtherB-30032286-project-member] Enqueued Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_members [ 1120.808368] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_members [ 1120.809200] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-c552e7e9-dc55-4efc-afb8-91a443d0679a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.809200] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.809200] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.809380] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.809747] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.809747] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.809953] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.810027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.810138] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.810260] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.841990] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03ba75eb-0083-4cd8-8b11-51faa2bd0718 [ 1120.841990] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.841990] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.841990] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.841990] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.842244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.842244] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03ba75eb-0083-4cd8-8b11-51faa2bd0718 already deleted. [ 1120.842302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03ba75eb-0083-4cd8-8b11-51faa2bd0718" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.892504] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad4a2118-b75b-4683-89be-e12ef55e1faa taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.892504] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.892806] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad4a2118-b75b-4683-89be-e12ef55e1faa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.893763] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1df10a84-7a2a-4530-bf96-d7e1b87b3f80 with status ACTIVE [ 1120.893985] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.894168] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.894219] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.894389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.894471] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.894654] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.894750] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.894816] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.895118] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.897525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.897525] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.897525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.897525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.897525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.897525] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.897525] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1df10a84-7a2a-4530-bf96-d7e1b87b3f80 is going to be updated. [ 1120.926852] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.926852] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.926852] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.926852] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.926852] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.926852] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1df10a84-7a2a-4530-bf96-d7e1b87b3f80" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.953560] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac in Status: SUCCESS [ 1120.953560] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.071069] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: SUCCESS [ 1121.072136] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.072136] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.072317] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.072473] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.072894] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.072894] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.072894] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.072894] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.073076] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.315572] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.315572] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.315572] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.315572] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.342309] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.342595] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.342689] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.342748] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.342958] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.343066] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.343157] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c552e7e9-dc55-4efc-afb8-91a443d0679a is going to be updated. [ 1121.384823] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.384823] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.384823] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.384823] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.384823] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.403506] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: IN_PROGRESS for 2s [ 1121.403936] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad4a2118-b75b-4683-89be-e12ef55e1faa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.410920] env[65322]: INFO networking_nsxv3.common.synchronization [req-79e0c7ac-8456-40a8-a315-a4f1bdce446e req-8c1149a8-7ee9-4ed5-ad25-838c05cab279 tempest-AttachInterfacesTestJSON-353803948 tempest-AttachInterfacesTestJSON-353803948-project-member] Enqueued Resource ID: 108c844e-abaf-4512-b72b-84435bbf4e4e with Priority: HIGHEST for action security_group_members [ 1121.411575] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108c844e-abaf-4512-b72b-84435bbf4e4e with Priority: HIGHEST for action security_group_members [ 1121.411916] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-108c844e-abaf-4512-b72b-84435bbf4e4e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.412084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.412150] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.412416] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.412618] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.412724] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.412789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.412948] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.413053] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.413149] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('108c844e-abaf-4512-b72b-84435bbf4e4e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.577051] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.577476] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.577576] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.577947] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.578044] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.578422] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.578660] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.578716] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.578941] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.579091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.579214] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 is going to be updated. [ 1121.616487] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.616734] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.616734] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.618249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.618819] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.634164] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: IN_PROGRESS for 2s [ 1121.911588] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.912138] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.912138] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.912236] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.915033] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.915033] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad4a2118-b75b-4683-89be-e12ef55e1faa is going to be created. [ 1121.918681] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.918845] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.918905] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.919219] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.950302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.951702] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.951702] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.951702] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.951702] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.952155] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.952302] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 108c844e-abaf-4512-b72b-84435bbf4e4e is going to be updated. [ 1121.969462] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.970467] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.970467] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.970467] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.970467] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.982917] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad4a2118-b75b-4683-89be-e12ef55e1faa in Status: UNINITIALIZED for 2s [ 1121.996858] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.996858] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.996858] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.996858] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.996858] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.008883] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 108c844e-abaf-4512-b72b-84435bbf4e4e in Status: IN_PROGRESS for 2s [ 1123.414403] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: SUCCESS [ 1123.414767] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c552e7e9-dc55-4efc-afb8-91a443d0679a deletion is rescheduled due to dependency. [ 1123.416090] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.645566] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: SUCCESS [ 1123.645764] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 deletion is rescheduled due to dependency. [ 1123.645943] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.736243] env[65322]: INFO networking_nsxv3.common.synchronization [None req-2a171e8a-e77a-4a0d-90b6-241e83d76ba5 None None] Enqueued Resource ID: e620d2c9-3846-4241-991e-1cd567cc1168 with Priority: HIGHEST for action port [ 1123.737118] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e620d2c9-3846-4241-991e-1cd567cc1168 with Priority: HIGHEST for action port [ 1123.737197] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-e620d2c9-3846-4241-991e-1cd567cc1168 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.737319] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e620d2c9-3846-4241-991e-1cd567cc1168" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.737384] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e620d2c9-3846-4241-991e-1cd567cc1168" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.737689] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e620d2c9-3846-4241-991e-1cd567cc1168" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.738176] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e620d2c9-3846-4241-991e-1cd567cc1168',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.999292] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad4a2118-b75b-4683-89be-e12ef55e1faa in Status: SUCCESS [ 1123.999292] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.999292] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.999292] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.999292] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.999292] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.999292] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.000281] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.000501] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.000692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.000955] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad4a2118-b75b-4683-89be-e12ef55e1faa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.020623] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 108c844e-abaf-4512-b72b-84435bbf4e4e in Status: SUCCESS [ 1124.020858] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 108c844e-abaf-4512-b72b-84435bbf4e4e deletion is rescheduled due to dependency. [ 1124.020977] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108c844e-abaf-4512-b72b-84435bbf4e4e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.240569] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e620d2c9-3846-4241-991e-1cd567cc1168 [ 1124.241627] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.241627] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.241627] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.241627] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.241627] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.241889] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e620d2c9-3846-4241-991e-1cd567cc1168 already deleted. [ 1124.241889] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e620d2c9-3846-4241-991e-1cd567cc1168" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.504023] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad4a2118-b75b-4683-89be-e12ef55e1faa taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.504023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.504023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.504467] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.504467] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.504581] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.504581] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.505088] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.505088] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.505088] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.505088] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad4a2118-b75b-4683-89be-e12ef55e1faa taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.505261] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.505261] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.505319] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.505456] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.505541] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.505599] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.505732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.505804] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.505975] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.506094] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad4a2118-b75b-4683-89be-e12ef55e1faa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.008621] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad4a2118-b75b-4683-89be-e12ef55e1faa: rpc.has_security_group_logging(os_id): False [ 1125.027822] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.027970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.028131] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.028345] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.028440] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.028634] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.028734] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.028794] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.028964] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.029050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.029238] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.029329] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.029390] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.029532] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.029605] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.029796] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.029889] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.029950] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.030098] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.030171] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.030254] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad4a2118-b75b-4683-89be-e12ef55e1faa is going to be created. [ 1125.097751] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.097925] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.097975] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.098208] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.098383] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.110145] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad4a2118-b75b-4683-89be-e12ef55e1faa in Status: IN_PROGRESS for 2s [ 1126.054334] env[65322]: INFO networking_nsxv3.common.synchronization [None req-be55cf42-d204-4214-82eb-145ae386511b tempest-AttachInterfacesTestJSON-353803948 tempest-AttachInterfacesTestJSON-353803948-project-member] Enqueued Resource ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef with Priority: HIGHEST for action security_group_rules [ 1126.054908] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef with Priority: HIGHEST for action security_group_rules [ 1126.055234] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea14cdbb-36fa-47a7-8e0f-957145b054ef taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.055352] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.055420] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.055682] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.055768] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea14cdbb-36fa-47a7-8e0f-957145b054ef',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.155407] env[65322]: INFO networking_nsxv3.common.synchronization [None req-0c5a9a3e-992b-49f0-a3b0-7bb5f67c0319 tempest-AttachInterfacesTestJSON-353803948 tempest-AttachInterfacesTestJSON-353803948-project-member] Enqueued Resource ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef with Priority: HIGHEST for action security_group_rules [ 1126.156073] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef with Priority: HIGHEST for action security_group_rules [ 1126.156401] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea14cdbb-36fa-47a7-8e0f-957145b054ef taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.156527] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.581472] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.581675] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.581675] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.581852] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.581941] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.582052] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef already deleted. [ 1126.582137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.582293] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.582460] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.582590] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea14cdbb-36fa-47a7-8e0f-957145b054ef',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.102841] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.103204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.103204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.103266] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.103320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.103420] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef already deleted. [ 1127.103502] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.125124] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad4a2118-b75b-4683-89be-e12ef55e1faa in Status: SUCCESS [ 1127.125730] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.958185] env[65322]: INFO networking_nsxv3.common.synchronization [req-135a9559-209d-49c3-8a85-b1f35154532d req-325c4d16-7808-417d-960f-914a4c27361c tempest-DeleteServersTestJSON-1463403857 tempest-DeleteServersTestJSON-1463403857-project-member] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 1129.958593] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 1129.958938] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.959825] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.959825] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.960008] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.960386] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.960509] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.960665] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.960743] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.961371] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.961371] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.323602] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-976 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.323959] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.324560] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.324560] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.326378] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.326760] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.326760] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.326900] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.327055] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.327265] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1130.328169] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1130.328169] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1130.328169] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1130.328169] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1130.328169] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1130.328169] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1130.350660] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1130.350838] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1130.350978] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1130.351189] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-976" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.351511] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-3e7c8d96-d61f-4f69-802d-ff01bcc5f5e6 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.351677] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-3e7c8d96-d61f-4f69-802d-ff01bcc5f5e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.351794] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-3e7c8d96-d61f-4f69-802d-ff01bcc5f5e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.352137] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-3e7c8d96-d61f-4f69-802d-ff01bcc5f5e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.352279] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e7c8d96-d61f-4f69-802d-ff01bcc5f5e6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.464088] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.464300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.464300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.464528] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.464618] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.464843] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.464951] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.465022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.465188] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.465266] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.465356] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be updated. [ 1130.497196] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.497427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.497475] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.497680] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.497824] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.509966] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: IN_PROGRESS for 2s [ 1130.855376] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.855689] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.855817] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.856194] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.856345] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.856505] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 3e7c8d96-d61f-4f69-802d-ff01bcc5f5e6 not found, creating... [ 1130.856782] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.856994] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.857169] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.857426] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.857564] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.857888] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.858105] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.858245] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.858468] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.858601] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.858738] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 3e7c8d96-d61f-4f69-802d-ff01bcc5f5e6 is going to be created. [ 1130.883836] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.884149] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.884297] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.884606] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.884860] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.885141] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-3e7c8d96-d61f-4f69-802d-ff01bcc5f5e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.608831] env[65322]: INFO networking_nsxv3.common.synchronization [req-135a9559-209d-49c3-8a85-b1f35154532d req-cc94f4ba-4483-4a41-8e99-8af4b9ab7e77 service nova] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_rules [ 1131.609214] env[65322]: INFO networking_nsxv3.common.synchronization [req-135a9559-209d-49c3-8a85-b1f35154532d req-cc94f4ba-4483-4a41-8e99-8af4b9ab7e77 service nova] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 1131.609214] env[65322]: INFO networking_nsxv3.common.synchronization [req-135a9559-209d-49c3-8a85-b1f35154532d req-cc94f4ba-4483-4a41-8e99-8af4b9ab7e77 service nova] Enqueued Resource ID: 3e7c8d96-d61f-4f69-802d-ff01bcc5f5e6 with Priority: HIGHEST for action port [ 1131.609825] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_rules [ 1131.609825] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 1131.610064] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e7c8d96-d61f-4f69-802d-ff01bcc5f5e6 with Priority: HIGHEST for action port [ 1131.611270] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.611403] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.611471] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.611673] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.611752] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.612578] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.612676] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.613628] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e7c8d96-d61f-4f69-802d-ff01bcc5f5e6 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.613750] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e7c8d96-d61f-4f69-802d-ff01bcc5f5e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.613814] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e7c8d96-d61f-4f69-802d-ff01bcc5f5e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.614605] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e7c8d96-d61f-4f69-802d-ff01bcc5f5e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.614605] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e7c8d96-d61f-4f69-802d-ff01bcc5f5e6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.115882] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.116115] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.116446] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e7c8d96-d61f-4f69-802d-ff01bcc5f5e6 with status ACTIVE [ 1132.116572] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.116715] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.116779] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.117091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.117186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.117378] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.117481] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.117596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.117727] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.117802] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.118024] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.118149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.118217] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.118452] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.118537] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.118622] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e7c8d96-d61f-4f69-802d-ff01bcc5f5e6 is going to be updated. [ 1132.140859] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.140955] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.141031] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.141277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.141418] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.141580] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e7c8d96-d61f-4f69-802d-ff01bcc5f5e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.521350] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: SUCCESS [ 1132.521524] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 deletion is rescheduled due to dependency. [ 1132.522091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.522091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.522319] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.522319] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.522447] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.522511] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.522680] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.522760] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.522861] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.025371] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.355433] env[65322]: INFO networking_nsxv3.common.synchronization [req-52110fe2-b596-4d63-8545-7b9a81f98042 req-f9cceccf-287e-4e7d-b9b4-f14337f16b36 tempest-ServerGroupTestJSON-1009492623 tempest-ServerGroupTestJSON-1009492623-project-member] Enqueued Resource ID: 4626348e-744c-4112-93ab-23fef8bda9e2 with Priority: HIGHEST for action security_group_members [ 1133.355594] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4626348e-744c-4112-93ab-23fef8bda9e2 with Priority: HIGHEST for action security_group_members [ 1133.355902] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4626348e-744c-4112-93ab-23fef8bda9e2 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.356194] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.356301] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.356588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.356757] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.356860] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.356923] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.357149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.357277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.357397] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4626348e-744c-4112-93ab-23fef8bda9e2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.529203] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.535929] env[65322]: INFO networking_nsxv3.common.synchronization [req-ad074498-dd97-424b-b217-e6f7eb533126 req-fb04e12d-5256-4661-879f-85331f14be9e tempest-ServerPasswordTestJSON-92536925 tempest-ServerPasswordTestJSON-92536925-project-member] Enqueued Resource ID: ad4a2118-b75b-4683-89be-e12ef55e1faa with Priority: HIGHEST for action security_group_members [ 1133.536570] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad4a2118-b75b-4683-89be-e12ef55e1faa with Priority: HIGHEST for action security_group_members [ 1133.536888] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad4a2118-b75b-4683-89be-e12ef55e1faa taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.537763] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.537763] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.537763] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.537763] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.538566] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.538566] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.538566] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.538566] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.538566] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad4a2118-b75b-4683-89be-e12ef55e1faa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.729407] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-463 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.729590] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-463" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.729734] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-463" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.730082] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-463" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.730514] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.730514] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.730669] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.730850] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.731044] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.731269] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1133.731404] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1133.731511] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1133.731615] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1133.731721] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1133.731821] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1133.731949] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1133.756309] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1133.756511] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1133.756677] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1133.756816] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-463" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.758015] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-d664edc1-1926-4a24-acc2-cb792c0a25ac taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.758015] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-d664edc1-1926-4a24-acc2-cb792c0a25ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.758015] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-d664edc1-1926-4a24-acc2-cb792c0a25ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.758015] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-d664edc1-1926-4a24-acc2-cb792c0a25ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.758223] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d664edc1-1926-4a24-acc2-cb792c0a25ac',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.860367] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.860545] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.860606] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.860807] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.860885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.861099] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.861200] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.861251] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.861391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.861467] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.861561] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4626348e-744c-4112-93ab-23fef8bda9e2 already deleted. [ 1133.861770] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.031621] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.032027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.032027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.032027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.032134] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.032258] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be updated. [ 1134.040322] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.040553] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.040619] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.040810] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.040904] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.041060] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.041157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.041288] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.041357] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.041423] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.041507] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad4a2118-b75b-4683-89be-e12ef55e1faa is going to be updated. [ 1134.066410] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.066617] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.066617] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.066971] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.066971] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.075546] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.075738] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.075738] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.075951] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.076130] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.077756] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: IN_PROGRESS for 2s [ 1134.086196] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad4a2118-b75b-4683-89be-e12ef55e1faa in Status: IN_PROGRESS for 2s [ 1134.262043] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.262404] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.262579] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.262926] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.263106] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.263298] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port d664edc1-1926-4a24-acc2-cb792c0a25ac not found, creating... [ 1134.263595] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.263776] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.263931] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.264238] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.264448] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.264797] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.264996] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.265167] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.265436] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.265618] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.265774] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: d664edc1-1926-4a24-acc2-cb792c0a25ac is going to be created. [ 1134.302185] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.302417] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.302541] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.302835] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.303138] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.303398] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-d664edc1-1926-4a24-acc2-cb792c0a25ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.004865] env[65322]: INFO networking_nsxv3.common.synchronization [req-52110fe2-b596-4d63-8545-7b9a81f98042 req-7823ca30-df8c-4c00-8235-31ee2809586e service nova] Enqueued Resource ID: 4626348e-744c-4112-93ab-23fef8bda9e2 with Priority: HIGHEST for action security_group_rules [ 1135.005129] env[65322]: INFO networking_nsxv3.common.synchronization [req-52110fe2-b596-4d63-8545-7b9a81f98042 req-7823ca30-df8c-4c00-8235-31ee2809586e service nova] Enqueued Resource ID: 4626348e-744c-4112-93ab-23fef8bda9e2 with Priority: HIGHEST for action security_group_members [ 1135.005340] env[65322]: INFO networking_nsxv3.common.synchronization [req-52110fe2-b596-4d63-8545-7b9a81f98042 req-7823ca30-df8c-4c00-8235-31ee2809586e service nova] Enqueued Resource ID: d664edc1-1926-4a24-acc2-cb792c0a25ac with Priority: HIGHEST for action port [ 1135.005922] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4626348e-744c-4112-93ab-23fef8bda9e2 with Priority: HIGHEST for action security_group_rules [ 1135.006134] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4626348e-744c-4112-93ab-23fef8bda9e2 with Priority: HIGHEST for action security_group_members [ 1135.006261] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d664edc1-1926-4a24-acc2-cb792c0a25ac with Priority: HIGHEST for action port [ 1135.006547] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4626348e-744c-4112-93ab-23fef8bda9e2 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.006679] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.006767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.007167] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.007272] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4626348e-744c-4112-93ab-23fef8bda9e2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.008206] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4626348e-744c-4112-93ab-23fef8bda9e2 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.008328] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.008407] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.008743] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.008743] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.008844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.008879] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.009078] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.009188] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.009278] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4626348e-744c-4112-93ab-23fef8bda9e2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.010140] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-d664edc1-1926-4a24-acc2-cb792c0a25ac taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.010252] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d664edc1-1926-4a24-acc2-cb792c0a25ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.010310] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d664edc1-1926-4a24-acc2-cb792c0a25ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.010476] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d664edc1-1926-4a24-acc2-cb792c0a25ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.010552] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d664edc1-1926-4a24-acc2-cb792c0a25ac',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.514067] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4626348e-744c-4112-93ab-23fef8bda9e2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.514067] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4626348e-744c-4112-93ab-23fef8bda9e2 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.514409] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.517086] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d664edc1-1926-4a24-acc2-cb792c0a25ac with status ACTIVE [ 1135.517309] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.517437] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.517515] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.517732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.517854] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.518194] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.518194] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.518194] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.518393] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.518472] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.518662] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.518755] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.518836] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.518980] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.519082] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.519169] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d664edc1-1926-4a24-acc2-cb792c0a25ac is going to be updated. [ 1135.547360] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.547536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.547606] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.547834] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.547982] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.548193] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d664edc1-1926-4a24-acc2-cb792c0a25ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.729697] env[65322]: INFO networking_nsxv3.common.synchronization [req-e20eb1cd-55e9-4bc6-8802-c077951d60b0 req-8e4753b8-612c-4016-94ce-6d2daf7f021e tempest-AttachInterfacesTestJSON-353803948 tempest-AttachInterfacesTestJSON-353803948-project-member] Enqueued Resource ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef with Priority: HIGHEST for action security_group_members [ 1135.730414] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef with Priority: HIGHEST for action security_group_members [ 1135.730759] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea14cdbb-36fa-47a7-8e0f-957145b054ef taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.730883] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.730949] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.731263] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.731506] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.731612] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.731677] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.731855] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.731960] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.732115] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea14cdbb-36fa-47a7-8e0f-957145b054ef',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.016108] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4626348e-744c-4112-93ab-23fef8bda9e2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.094035] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: SUCCESS [ 1136.094035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.094035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.094035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.094035] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.094035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.094035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.094035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.094035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.094035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.094035] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.098236] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad4a2118-b75b-4683-89be-e12ef55e1faa in Status: SUCCESS [ 1136.098403] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad4a2118-b75b-4683-89be-e12ef55e1faa deletion is rescheduled due to dependency. [ 1136.098813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.166887] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-896 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.167193] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.167330] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.168128] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.168128] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.168128] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.168263] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.168416] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.168549] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.169674] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1136.169674] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1136.169674] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1136.169674] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1136.169674] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1136.169674] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1136.169674] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1136.189979] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1136.190258] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1136.190321] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1136.190485] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.190799] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-82104d02-48a6-4728-8275-dfe26b2bc105 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.190997] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-82104d02-48a6-4728-8275-dfe26b2bc105" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.191134] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-82104d02-48a6-4728-8275-dfe26b2bc105" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.191467] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-82104d02-48a6-4728-8275-dfe26b2bc105" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.191603] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82104d02-48a6-4728-8275-dfe26b2bc105',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.234834] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.235025] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.235115] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.235370] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.235463] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.235688] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.235805] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.235868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.236071] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.236177] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.236265] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef already deleted. [ 1136.236349] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.521760] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.521760] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.521760] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.521760] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.521760] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.521760] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4626348e-744c-4112-93ab-23fef8bda9e2 is going to be created. [ 1136.555919] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.556172] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.556172] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.556387] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.556548] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.569152] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4626348e-744c-4112-93ab-23fef8bda9e2 in Status: UNINITIALIZED for 2s [ 1136.599042] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.599042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.599042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.599042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.599356] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.599356] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.599356] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.599468] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.599506] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.599582] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.599730] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.599820] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.599878] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.600033] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.600177] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.600309] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.600386] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.600544] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.600625] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.600720] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.600819] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.694368] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.694575] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.694657] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.694956] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.695125] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.695283] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 82104d02-48a6-4728-8275-dfe26b2bc105 not found, creating... [ 1136.695544] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.695699] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.695811] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.696075] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.696227] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.696511] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.696665] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.696779] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.696982] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.697125] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.697264] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 82104d02-48a6-4728-8275-dfe26b2bc105 is going to be created. [ 1136.718455] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.718694] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.718846] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.719173] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.719432] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.719706] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-82104d02-48a6-4728-8275-dfe26b2bc105" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.106247] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e863a544-814a-4bca-b4b1-35f9a61afcd3: rpc.has_security_group_logging(os_id): False [ 1137.127753] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.127956] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.128013] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.128210] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.128300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.128525] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.128669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.128738] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.128897] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.128978] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.129208] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.129302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.129360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.129499] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.129572] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.129767] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.129855] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.129913] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.130175] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.130284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.130392] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be updated. [ 1137.207662] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.207907] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.207907] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.208608] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.208608] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.232373] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: IN_PROGRESS for 2s [ 1137.506388] env[65322]: INFO networking_nsxv3.common.synchronization [req-e20eb1cd-55e9-4bc6-8802-c077951d60b0 req-ae1aa50e-0021-4b1e-b255-3f84b3747542 service nova] Enqueued Resource ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef with Priority: HIGHEST for action security_group_rules [ 1137.506599] env[65322]: INFO networking_nsxv3.common.synchronization [req-e20eb1cd-55e9-4bc6-8802-c077951d60b0 req-ae1aa50e-0021-4b1e-b255-3f84b3747542 service nova] Enqueued Resource ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef with Priority: HIGHEST for action security_group_members [ 1137.506682] env[65322]: INFO networking_nsxv3.common.synchronization [req-e20eb1cd-55e9-4bc6-8802-c077951d60b0 req-ae1aa50e-0021-4b1e-b255-3f84b3747542 service nova] Enqueued Resource ID: 82104d02-48a6-4728-8275-dfe26b2bc105 with Priority: HIGHEST for action port [ 1137.507278] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef with Priority: HIGHEST for action security_group_rules [ 1137.507374] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef with Priority: HIGHEST for action security_group_members [ 1137.507465] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82104d02-48a6-4728-8275-dfe26b2bc105 with Priority: HIGHEST for action port [ 1137.507748] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea14cdbb-36fa-47a7-8e0f-957145b054ef taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.507876] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.507960] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.508316] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.508427] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea14cdbb-36fa-47a7-8e0f-957145b054ef',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.509753] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea14cdbb-36fa-47a7-8e0f-957145b054ef taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.509879] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.509944] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.510150] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.510353] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.510461] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.512223] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.512431] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.512532] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.512630] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea14cdbb-36fa-47a7-8e0f-957145b054ef',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.513502] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-82104d02-48a6-4728-8275-dfe26b2bc105 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.513615] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82104d02-48a6-4728-8275-dfe26b2bc105" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.513681] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82104d02-48a6-4728-8275-dfe26b2bc105" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.513926] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82104d02-48a6-4728-8275-dfe26b2bc105" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.514154] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82104d02-48a6-4728-8275-dfe26b2bc105',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.016260] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea14cdbb-36fa-47a7-8e0f-957145b054ef taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.016537] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.016658] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea14cdbb-36fa-47a7-8e0f-957145b054ef',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.017731] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82104d02-48a6-4728-8275-dfe26b2bc105 with status ACTIVE [ 1138.018057] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.018201] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.018262] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.018546] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.018699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.019122] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.019122] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.019122] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.019352] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.019493] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.020189] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.020189] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.020189] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.020189] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.020397] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.020397] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82104d02-48a6-4728-8275-dfe26b2bc105 is going to be updated. [ 1138.046538] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.046679] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.046780] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.047046] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.047213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.047488] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82104d02-48a6-4728-8275-dfe26b2bc105" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.162328] env[65322]: INFO networking_nsxv3.common.synchronization [req-56ab50e9-4ad1-434a-879a-b983b2a17bb1 req-bdce38e5-7d84-4689-a7c2-ae2cd5ea0119 tempest-ServerActionsTestOtherB-30032286 tempest-ServerActionsTestOtherB-30032286-project-member] Enqueued Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_members [ 1138.166157] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_members [ 1138.169184] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-c552e7e9-dc55-4efc-afb8-91a443d0679a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.169184] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.169184] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.169184] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.169184] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.169184] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.169184] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.169184] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.169184] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.169184] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.522714] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea14cdbb-36fa-47a7-8e0f-957145b054ef',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.580376] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4626348e-744c-4112-93ab-23fef8bda9e2 in Status: SUCCESS [ 1138.580613] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.580773] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.580998] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.581204] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.581322] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.581388] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.581553] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.581631] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.581716] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.581799] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4626348e-744c-4112-93ab-23fef8bda9e2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.596381] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-580 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.598253] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-580" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.598506] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-580" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.599212] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-580" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.599483] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.599735] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.599905] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.600235] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.600446] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.601226] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1138.601226] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1138.601226] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1138.601226] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1138.601226] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1138.601461] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1138.601592] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1138.627471] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1138.627664] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1138.627804] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1138.627993] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-580" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.628383] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-df1e4331-4fbb-4793-8312-f3ac29ecc291 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.628575] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-df1e4331-4fbb-4793-8312-f3ac29ecc291" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.628721] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-df1e4331-4fbb-4793-8312-f3ac29ecc291" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.629134] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-df1e4331-4fbb-4793-8312-f3ac29ecc291" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.629292] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df1e4331-4fbb-4793-8312-f3ac29ecc291',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.670091] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.670294] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.670343] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.670641] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.670764] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.670950] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.671119] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.671203] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.671385] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.671489] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.671584] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c552e7e9-dc55-4efc-afb8-91a443d0679a is going to be updated. [ 1138.705151] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.705320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.705819] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.706161] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.706321] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.716996] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: IN_PROGRESS for 2s [ 1139.027340] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.027694] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.027694] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.027784] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.027982] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.028151] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef is going to be created. [ 1139.056926] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.057216] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.057286] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.057572] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.057772] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.069280] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef in Status: UNINITIALIZED for 2s [ 1139.083985] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4626348e-744c-4112-93ab-23fef8bda9e2 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.084189] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.084265] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.084507] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.084685] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.084787] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.084849] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.084998] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.085154] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.085250] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.085406] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4626348e-744c-4112-93ab-23fef8bda9e2 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.085504] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.085566] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.085712] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.085900] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.086080] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.086169] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.086391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.086517] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.086647] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.086789] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4626348e-744c-4112-93ab-23fef8bda9e2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.131694] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.131969] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.132133] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.132411] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.132567] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.132733] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port df1e4331-4fbb-4793-8312-f3ac29ecc291 not found, creating... [ 1139.133008] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.133260] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.133318] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.133576] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.133720] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.134074] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.134341] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.134528] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.134793] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.134988] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.135224] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: df1e4331-4fbb-4793-8312-f3ac29ecc291 is going to be created. [ 1139.158137] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.158384] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.158541] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.158835] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.159074] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.159330] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-df1e4331-4fbb-4793-8312-f3ac29ecc291" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.277422] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: SUCCESS [ 1139.278611] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.589776] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4626348e-744c-4112-93ab-23fef8bda9e2: rpc.has_security_group_logging(os_id): False [ 1139.616449] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.616651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.616651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.617093] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.617093] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.617224] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.617346] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.617397] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.617669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.617669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.617883] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.617965] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.617965] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.618129] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.618205] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.618762] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.618762] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.618762] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.619029] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.619029] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.619029] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4626348e-744c-4112-93ab-23fef8bda9e2 is going to be created. [ 1139.696142] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.696550] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.696781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.697271] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.697672] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.711999] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4626348e-744c-4112-93ab-23fef8bda9e2 in Status: IN_PROGRESS for 2s [ 1139.875341] env[65322]: INFO networking_nsxv3.common.synchronization [req-56ab50e9-4ad1-434a-879a-b983b2a17bb1 req-81283a07-3b7e-4e4b-9ce8-044c9689160f service nova] Enqueued Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_rules [ 1139.875515] env[65322]: INFO networking_nsxv3.common.synchronization [req-56ab50e9-4ad1-434a-879a-b983b2a17bb1 req-81283a07-3b7e-4e4b-9ce8-044c9689160f service nova] Enqueued Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_members [ 1139.875642] env[65322]: INFO networking_nsxv3.common.synchronization [req-56ab50e9-4ad1-434a-879a-b983b2a17bb1 req-81283a07-3b7e-4e4b-9ce8-044c9689160f service nova] Enqueued Resource ID: df1e4331-4fbb-4793-8312-f3ac29ecc291 with Priority: HIGHEST for action port [ 1139.876256] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_rules [ 1139.876387] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_members [ 1139.876479] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df1e4331-4fbb-4793-8312-f3ac29ecc291 with Priority: HIGHEST for action port [ 1139.878033] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c552e7e9-dc55-4efc-afb8-91a443d0679a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.878181] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.878181] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.878327] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.878407] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.882690] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-c552e7e9-dc55-4efc-afb8-91a443d0679a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.882813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.883031] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-df1e4331-4fbb-4793-8312-f3ac29ecc291 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.883137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df1e4331-4fbb-4793-8312-f3ac29ecc291" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.883195] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df1e4331-4fbb-4793-8312-f3ac29ecc291" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.884131] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df1e4331-4fbb-4793-8312-f3ac29ecc291" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.884131] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df1e4331-4fbb-4793-8312-f3ac29ecc291',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.383151] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-c552e7e9-dc55-4efc-afb8-91a443d0679a taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.383476] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.386750] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df1e4331-4fbb-4793-8312-f3ac29ecc291 with status ACTIVE [ 1140.386996] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.387195] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.387304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.387551] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.387687] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.387901] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.388036] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.388132] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.388327] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.388432] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.388676] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.388796] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.388873] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.389086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.389183] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.389317] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df1e4331-4fbb-4793-8312-f3ac29ecc291 is going to be updated. [ 1140.425277] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.425277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.425277] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.425494] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.425544] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.425704] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df1e4331-4fbb-4793-8312-f3ac29ecc291" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.589229] env[65322]: INFO networking_nsxv3.common.synchronization [req-8a2fb96a-77c4-4000-9353-e84913415c35 req-7bd8b09c-3a6a-418f-b7a4-3c03eaa3fcd4 tempest-ServerActionsTestOtherA-1162989957 tempest-ServerActionsTestOtherA-1162989957-project-member] Enqueued Resource ID: e4dca03f-65fb-4951-910c-8904302d70fa with Priority: HIGHEST for action security_group_members [ 1140.589960] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4dca03f-65fb-4951-910c-8904302d70fa with Priority: HIGHEST for action security_group_members [ 1140.590405] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4dca03f-65fb-4951-910c-8904302d70fa taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.590526] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.590663] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.590871] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.591060] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.591208] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.591246] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.591368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.591448] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.591539] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4dca03f-65fb-4951-910c-8904302d70fa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.741186] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: SUCCESS [ 1140.741509] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c552e7e9-dc55-4efc-afb8-91a443d0679a deletion is rescheduled due to dependency. [ 1140.741679] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.741901] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.742264] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.742521] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.742715] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.742824] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.743093] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.743214] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.743351] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.991783] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-315 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.992076] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-315" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.992192] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-315" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.992603] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-315" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.992978] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.993387] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.993512] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.993744] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.993889] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.994135] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1140.994286] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1140.994425] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1140.994585] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1140.994722] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1140.994871] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1140.995084] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1141.019246] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1141.019440] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1141.019642] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1141.019839] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-315" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.020235] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-f1b1525c-935f-4ef4-8625-a1922dbd5ac8 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.020437] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-f1b1525c-935f-4ef4-8625-a1922dbd5ac8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.020558] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-f1b1525c-935f-4ef4-8625-a1922dbd5ac8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.020967] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-f1b1525c-935f-4ef4-8625-a1922dbd5ac8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.021152] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1b1525c-935f-4ef4-8625-a1922dbd5ac8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.079793] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef in Status: SUCCESS [ 1141.080045] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.080223] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.080461] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.080673] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.080795] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.080861] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.081031] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.081116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.081205] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.081295] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea14cdbb-36fa-47a7-8e0f-957145b054ef',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.095900] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4dca03f-65fb-4951-910c-8904302d70fa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.246411] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.524218] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.524586] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.524654] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.524989] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.525158] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.525336] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port f1b1525c-935f-4ef4-8625-a1922dbd5ac8 not found, creating... [ 1141.525618] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.525768] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.525876] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.526193] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.526364] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.526745] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.526920] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.527099] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.527384] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.527553] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.527724] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: f1b1525c-935f-4ef4-8625-a1922dbd5ac8 is going to be created. [ 1141.558560] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.558814] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.559017] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.559698] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.560080] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.560391] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-f1b1525c-935f-4ef4-8625-a1922dbd5ac8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.584243] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea14cdbb-36fa-47a7-8e0f-957145b054ef',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.599060] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4dca03f-65fb-4951-910c-8904302d70fa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.726756] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4626348e-744c-4112-93ab-23fef8bda9e2 in Status: SUCCESS [ 1141.727046] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.749249] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.086616] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea14cdbb-36fa-47a7-8e0f-957145b054ef: rpc.has_security_group_logging(os_id): False [ 1142.102599] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.102764] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.102834] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.103087] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.103744] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.103744] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4dca03f-65fb-4951-910c-8904302d70fa is going to be updated. [ 1142.106580] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.106707] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.106791] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.106966] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.107110] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.107549] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.107549] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.107549] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.107690] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.107772] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.107834] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef is going to be created. [ 1142.142367] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.142522] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.142566] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.142776] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.142915] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.157218] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4dca03f-65fb-4951-910c-8904302d70fa in Status: IN_PROGRESS for 2s [ 1142.183944] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.183944] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.183944] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.184145] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.184876] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.205318] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef in Status: IN_PROGRESS for 2s [ 1142.251987] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.252225] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.252225] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.252481] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.252552] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.252661] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c552e7e9-dc55-4efc-afb8-91a443d0679a is going to be updated. [ 1142.335826] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.336028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.336126] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.336473] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.336642] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.346844] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: IN_PROGRESS for 2s [ 1142.356667] env[65322]: INFO networking_nsxv3.common.synchronization [req-8a2fb96a-77c4-4000-9353-e84913415c35 req-cc563aa9-3625-4ddf-9e40-2d6f97d021c1 service nova] Enqueued Resource ID: e4dca03f-65fb-4951-910c-8904302d70fa with Priority: HIGHEST for action security_group_rules [ 1142.356784] env[65322]: INFO networking_nsxv3.common.synchronization [req-8a2fb96a-77c4-4000-9353-e84913415c35 req-cc563aa9-3625-4ddf-9e40-2d6f97d021c1 service nova] Enqueued Resource ID: e4dca03f-65fb-4951-910c-8904302d70fa with Priority: HIGHEST for action security_group_members [ 1142.356918] env[65322]: INFO networking_nsxv3.common.synchronization [req-8a2fb96a-77c4-4000-9353-e84913415c35 req-cc563aa9-3625-4ddf-9e40-2d6f97d021c1 service nova] Enqueued Resource ID: f1b1525c-935f-4ef4-8625-a1922dbd5ac8 with Priority: HIGHEST for action port [ 1142.357526] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4dca03f-65fb-4951-910c-8904302d70fa with Priority: HIGHEST for action security_group_rules [ 1142.357792] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4dca03f-65fb-4951-910c-8904302d70fa with Priority: HIGHEST for action security_group_members [ 1142.357876] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1b1525c-935f-4ef4-8625-a1922dbd5ac8 with Priority: HIGHEST for action port [ 1142.358271] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4dca03f-65fb-4951-910c-8904302d70fa taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.358374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.358446] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.358685] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.358968] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4dca03f-65fb-4951-910c-8904302d70fa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.360223] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4dca03f-65fb-4951-910c-8904302d70fa taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.360329] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.360538] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1b1525c-935f-4ef4-8625-a1922dbd5ac8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.360630] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1b1525c-935f-4ef4-8625-a1922dbd5ac8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.360693] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1b1525c-935f-4ef4-8625-a1922dbd5ac8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.360878] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1b1525c-935f-4ef4-8625-a1922dbd5ac8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.360945] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1b1525c-935f-4ef4-8625-a1922dbd5ac8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.774493] env[65322]: INFO networking_nsxv3.common.synchronization [req-a7c441a0-6545-4835-b47c-2f8bca3d0cf9 req-c18012f5-c403-4eb8-ad58-37d703436c18 tempest-ServerActionsTestJSON-71326710 tempest-ServerActionsTestJSON-71326710-project-member] Enqueued Resource ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 with Priority: HIGHEST for action security_group_members [ 1142.775036] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 with Priority: HIGHEST for action security_group_members [ 1142.775358] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.775482] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.775550] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.775780] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.776053] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.776230] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.776283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.777208] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.777208] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.777208] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.864052] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4dca03f-65fb-4951-910c-8904302d70fa taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.864470] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.866252] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f1b1525c-935f-4ef4-8625-a1922dbd5ac8 with status ACTIVE [ 1142.866681] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.866907] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.867124] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.867495] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.867606] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.867923] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.868124] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.868288] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.868569] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.868711] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.869137] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.869244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.869353] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.869603] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.869735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.869891] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f1b1525c-935f-4ef4-8625-a1922dbd5ac8 is going to be updated. [ 1142.913953] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.914637] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.914744] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.915023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.915185] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.915630] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1b1525c-935f-4ef4-8625-a1922dbd5ac8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.279620] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.280078] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.280078] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.280228] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.328649] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.329225] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.330191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.330191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.330191] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.330408] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.330545] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 is going to be updated. [ 1143.382418] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.382667] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.382745] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.383032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.383264] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.395063] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 in Status: IN_PROGRESS for 2s [ 1144.171748] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4dca03f-65fb-4951-910c-8904302d70fa in Status: SUCCESS [ 1144.172052] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.172160] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.172364] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.172557] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.172674] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.172736] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.172889] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.173271] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.173271] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4dca03f-65fb-4951-910c-8904302d70fa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.222821] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef in Status: SUCCESS [ 1144.224881] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.361879] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: SUCCESS [ 1144.362469] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.362469] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.363187] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.363187] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.363187] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.363443] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.363443] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.363540] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.363606] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.363736] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.675185] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4dca03f-65fb-4951-910c-8904302d70fa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.712177] env[65322]: INFO networking_nsxv3.common.synchronization [req-d82fc631-aa9f-4869-89e0-f921ba62270a req-07fb6925-ceb3-4b2d-9db5-d5f3213e52ee tempest-ServerGroupTestJSON-1009492623 tempest-ServerGroupTestJSON-1009492623-project-member] Enqueued Resource ID: 4626348e-744c-4112-93ab-23fef8bda9e2 with Priority: HIGHEST for action security_group_members [ 1144.712828] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4626348e-744c-4112-93ab-23fef8bda9e2 with Priority: HIGHEST for action security_group_members [ 1144.713286] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4626348e-744c-4112-93ab-23fef8bda9e2 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.713479] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.713588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.713885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.714144] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.714352] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.714459] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.714665] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.714799] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.714932] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4626348e-744c-4112-93ab-23fef8bda9e2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.866024] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.177945] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4dca03f-65fb-4951-910c-8904302d70fa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.218801] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.218801] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.218801] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.218801] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.218801] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.219266] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.219266] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.219266] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.219463] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.219539] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.219630] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4626348e-744c-4112-93ab-23fef8bda9e2 is going to be updated. [ 1145.259685] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.260142] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.260384] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.260889] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.261684] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.275850] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4626348e-744c-4112-93ab-23fef8bda9e2 in Status: IN_PROGRESS for 2s [ 1145.372694] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c552e7e9-dc55-4efc-afb8-91a443d0679a: rpc.has_security_group_logging(os_id): False [ 1145.395048] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.395205] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.395283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.395512] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.395604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.395874] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.396738] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.396738] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.396738] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.396738] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.396738] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c552e7e9-dc55-4efc-afb8-91a443d0679a is going to be updated. [ 1145.422318] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 in Status: SUCCESS [ 1145.423061] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 deletion is rescheduled due to dependency. [ 1145.423061] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.487266] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.487436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.487536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.487788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.487940] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.511751] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: IN_PROGRESS for 2s [ 1145.681506] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.681705] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.681744] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.682045] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.682193] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.682316] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4dca03f-65fb-4951-910c-8904302d70fa is going to be updated. [ 1145.729686] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.729886] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.729967] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.730195] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.730371] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.749469] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4dca03f-65fb-4951-910c-8904302d70fa in Status: IN_PROGRESS for 2s [ 1147.293524] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4626348e-744c-4112-93ab-23fef8bda9e2 in Status: SUCCESS [ 1147.293992] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4626348e-744c-4112-93ab-23fef8bda9e2 deletion is rescheduled due to dependency. [ 1147.293992] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.528483] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: SUCCESS [ 1147.528746] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.761521] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4dca03f-65fb-4951-910c-8904302d70fa in Status: SUCCESS [ 1147.761796] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.762091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.762260] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.762696] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.762792] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.762851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.764551] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.764551] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.764551] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.764551] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4dca03f-65fb-4951-910c-8904302d70fa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.268543] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4dca03f-65fb-4951-910c-8904302d70fa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.772079] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4dca03f-65fb-4951-910c-8904302d70fa: rpc.has_security_group_logging(os_id): False [ 1148.792854] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.793169] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.793169] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.793335] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.821509] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.821929] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.822037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.822075] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.822311] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.822420] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.822520] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4dca03f-65fb-4951-910c-8904302d70fa is going to be updated. [ 1148.893759] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.893970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.894905] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.894905] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.895268] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.912132] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4dca03f-65fb-4951-910c-8904302d70fa in Status: IN_PROGRESS for 2s [ 1149.713894] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1149.714037] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1150.946415] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4dca03f-65fb-4951-910c-8904302d70fa in Status: SUCCESS [ 1150.946768] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.384132] env[65322]: INFO networking_nsxv3.common.synchronization [req-abf10ccd-778e-47d2-8cc5-2a731fcf2159 req-52b28125-0b20-4c0b-9711-ab245555b0c7 tempest-AttachInterfacesTestJSON-353803948 tempest-AttachInterfacesTestJSON-353803948-project-member] Enqueued Resource ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef with Priority: HIGHEST for action security_group_members [ 1153.384774] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef with Priority: HIGHEST for action security_group_members [ 1153.385111] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea14cdbb-36fa-47a7-8e0f-957145b054ef taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.385232] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.385347] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.385491] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.385641] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.385742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.385792] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.385922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.386098] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.386098] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea14cdbb-36fa-47a7-8e0f-957145b054ef',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.704247] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-896 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.704490] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.704650] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.704948] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.705316] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.705651] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.705651] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.705819] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.705961] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.706177] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1153.706351] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1153.706467] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1153.706568] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1153.706680] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1153.706767] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1153.706891] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1153.729396] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1153.729566] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1153.729684] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1153.729854] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.730190] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-a803b3e5-e51a-4603-afbe-5a5311002ae0 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.730357] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-a803b3e5-e51a-4603-afbe-5a5311002ae0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.730547] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-a803b3e5-e51a-4603-afbe-5a5311002ae0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.730978] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-a803b3e5-e51a-4603-afbe-5a5311002ae0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.730978] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a803b3e5-e51a-4603-afbe-5a5311002ae0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.889049] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea14cdbb-36fa-47a7-8e0f-957145b054ef',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.233841] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.234089] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.234226] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.237756] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.237756] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.237756] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port a803b3e5-e51a-4603-afbe-5a5311002ae0 not found, creating... [ 1154.237756] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.237756] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.237756] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.237756] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.237756] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.237756] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.237756] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.238319] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.238319] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.238319] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.238319] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: a803b3e5-e51a-4603-afbe-5a5311002ae0 is going to be created. [ 1154.259147] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.259536] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.259687] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.260053] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.260338] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.260612] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-a803b3e5-e51a-4603-afbe-5a5311002ae0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.390717] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea14cdbb-36fa-47a7-8e0f-957145b054ef',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.893241] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.893873] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.893981] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.894252] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.894590] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.894816] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef is going to be updated. [ 1154.929640] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.929851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.929851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.930076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.930241] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.942327] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef in Status: IN_PROGRESS for 2s [ 1154.973019] env[65322]: INFO networking_nsxv3.common.synchronization [req-abf10ccd-778e-47d2-8cc5-2a731fcf2159 req-cabc6122-f1f2-49c8-b9cb-e1a314e2b7c1 service nova] Enqueued Resource ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef with Priority: HIGHEST for action security_group_rules [ 1154.973246] env[65322]: INFO networking_nsxv3.common.synchronization [req-abf10ccd-778e-47d2-8cc5-2a731fcf2159 req-cabc6122-f1f2-49c8-b9cb-e1a314e2b7c1 service nova] Enqueued Resource ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef with Priority: HIGHEST for action security_group_members [ 1154.973632] env[65322]: INFO networking_nsxv3.common.synchronization [req-abf10ccd-778e-47d2-8cc5-2a731fcf2159 req-cabc6122-f1f2-49c8-b9cb-e1a314e2b7c1 service nova] Enqueued Resource ID: a803b3e5-e51a-4603-afbe-5a5311002ae0 with Priority: HIGHEST for action port [ 1154.973960] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef with Priority: HIGHEST for action security_group_rules [ 1154.974123] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef with Priority: HIGHEST for action security_group_members [ 1154.974267] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a803b3e5-e51a-4603-afbe-5a5311002ae0 with Priority: HIGHEST for action port [ 1154.974569] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea14cdbb-36fa-47a7-8e0f-957145b054ef taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.974725] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.974791] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.974988] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.975092] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea14cdbb-36fa-47a7-8e0f-957145b054ef',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.976744] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea14cdbb-36fa-47a7-8e0f-957145b054ef taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.976874] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.977096] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-a803b3e5-e51a-4603-afbe-5a5311002ae0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.977179] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a803b3e5-e51a-4603-afbe-5a5311002ae0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.977239] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a803b3e5-e51a-4603-afbe-5a5311002ae0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.977456] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a803b3e5-e51a-4603-afbe-5a5311002ae0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.977528] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a803b3e5-e51a-4603-afbe-5a5311002ae0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.479642] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea14cdbb-36fa-47a7-8e0f-957145b054ef taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.479945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.479945] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a803b3e5-e51a-4603-afbe-5a5311002ae0 with status ACTIVE [ 1155.480129] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.480236] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.480296] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.480734] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.480895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.481192] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.481353] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.481459] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.481730] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.481907] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.482153] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.482257] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.482337] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.482480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.482588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.482679] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a803b3e5-e51a-4603-afbe-5a5311002ae0 is going to be updated. [ 1155.508856] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.509115] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.509115] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.509306] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.509448] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.509617] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a803b3e5-e51a-4603-afbe-5a5311002ae0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.773557] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.773557] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-547" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.773663] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-547" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.773909] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-547" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.774218] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.774407] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.774525] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.774791] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.774878] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.775099] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1155.775208] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1155.775311] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1155.775414] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1155.775514] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1155.775613] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1155.775753] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1155.799105] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1155.799288] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1155.799489] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1155.799672] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-547" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.799985] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-7d753267-1975-44a1-9706-13a4d42c8602 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.800168] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-7d753267-1975-44a1-9706-13a4d42c8602" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.800283] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-7d753267-1975-44a1-9706-13a4d42c8602" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.800548] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-7d753267-1975-44a1-9706-13a4d42c8602" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.800681] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d753267-1975-44a1-9706-13a4d42c8602',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.305478] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.305862] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.306029] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.306379] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.306525] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.306862] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.307078] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.307205] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.307486] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.307629] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.308181] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.308400] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.308591] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.308866] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.309052] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.309235] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 7d753267-1975-44a1-9706-13a4d42c8602 is going to be updated. [ 1156.333809] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.334645] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.334645] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.334645] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.334861] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.334897] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-7d753267-1975-44a1-9706-13a4d42c8602" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.952710] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef in Status: SUCCESS [ 1156.953169] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.953239] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.953427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.953691] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.953747] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.953788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.953918] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.953996] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.954103] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea14cdbb-36fa-47a7-8e0f-957145b054ef',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.070350] env[65322]: INFO networking_nsxv3.common.synchronization [req-3f770419-ef2e-41cd-a5bb-0fb79cb0bac8 req-0020a703-6763-487c-9228-935752ceee1e service nova] Enqueued Resource ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 with Priority: HIGHEST for action security_group_rules [ 1157.070522] env[65322]: INFO networking_nsxv3.common.synchronization [req-3f770419-ef2e-41cd-a5bb-0fb79cb0bac8 req-0020a703-6763-487c-9228-935752ceee1e service nova] Enqueued Resource ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 with Priority: HIGHEST for action security_group_members [ 1157.070652] env[65322]: INFO networking_nsxv3.common.synchronization [req-3f770419-ef2e-41cd-a5bb-0fb79cb0bac8 req-0020a703-6763-487c-9228-935752ceee1e service nova] Enqueued Resource ID: 7d753267-1975-44a1-9706-13a4d42c8602 with Priority: HIGHEST for action port [ 1157.071199] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 with Priority: HIGHEST for action security_group_rules [ 1157.071329] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 with Priority: HIGHEST for action security_group_members [ 1157.071404] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d753267-1975-44a1-9706-13a4d42c8602 with Priority: HIGHEST for action port [ 1157.071826] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5b6c61f-b9c6-44e9-934b-c9925befabf7 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.071826] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.071826] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.073445] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.073635] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5b6c61f-b9c6-44e9-934b-c9925befabf7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.075048] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5b6c61f-b9c6-44e9-934b-c9925befabf7 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.075290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.075368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.075669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.075947] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.076170] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.076310] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.076598] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.076751] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.076931] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5b6c61f-b9c6-44e9-934b-c9925befabf7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.078149] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d753267-1975-44a1-9706-13a4d42c8602 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.078314] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d753267-1975-44a1-9706-13a4d42c8602" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.078425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d753267-1975-44a1-9706-13a4d42c8602" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.078632] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d753267-1975-44a1-9706-13a4d42c8602" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.078701] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d753267-1975-44a1-9706-13a4d42c8602',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.457327] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea14cdbb-36fa-47a7-8e0f-957145b054ef',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.580659] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d5b6c61f-b9c6-44e9-934b-c9925befabf7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.582032] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5b6c61f-b9c6-44e9-934b-c9925befabf7 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.582032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.582032] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d753267-1975-44a1-9706-13a4d42c8602 with status ACTIVE [ 1157.582032] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.582327] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.582327] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.582489] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.583116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.583116] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.583116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.583116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.583116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.584360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.584360] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.584360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.584360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.584360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.584360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.584360] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d753267-1975-44a1-9706-13a4d42c8602 is going to be updated. [ 1157.607591] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.607768] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.607768] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.607966] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.608116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.608272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d753267-1975-44a1-9706-13a4d42c8602" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.959799] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea14cdbb-36fa-47a7-8e0f-957145b054ef',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.085999] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d5b6c61f-b9c6-44e9-934b-c9925befabf7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.462521] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.462684] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.462755] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.462996] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.463101] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.463238] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef is going to be updated. [ 1158.498140] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.498140] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.499034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.499034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.499034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.509668] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef in Status: IN_PROGRESS for 2s [ 1158.588328] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.588495] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.588536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.589110] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.589110] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.589110] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 is going to be updated. [ 1158.620023] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.620023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.620023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.620023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.620023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.631600] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 in Status: IN_PROGRESS for 2s [ 1160.522309] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef in Status: SUCCESS [ 1160.522309] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.522735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.522735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.522807] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.522930] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.522994] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.523237] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.523237] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.523324] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.523401] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea14cdbb-36fa-47a7-8e0f-957145b054ef',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.644772] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 in Status: SUCCESS [ 1160.644984] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.645168] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.645391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.645581] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.646270] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.646270] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.646270] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.646270] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.646270] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.646270] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d5b6c61f-b9c6-44e9-934b-c9925befabf7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.025610] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea14cdbb-36fa-47a7-8e0f-957145b054ef',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.149518] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d5b6c61f-b9c6-44e9-934b-c9925befabf7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.189729] env[65322]: INFO networking_nsxv3.common.synchronization [req-78329d53-6508-472e-b840-e3f6f1c5e9b5 req-d946f804-8b69-4356-a363-e296e3f99e70 tempest-AttachVolumeTestJSON-1389790413 tempest-AttachVolumeTestJSON-1389790413-project-member] Enqueued Resource ID: ff72da15-0579-4c17-8921-0de51b66ecbf with Priority: HIGHEST for action security_group_members [ 1161.190795] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff72da15-0579-4c17-8921-0de51b66ecbf with Priority: HIGHEST for action security_group_members [ 1161.191164] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff72da15-0579-4c17-8921-0de51b66ecbf taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.191297] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.191359] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.191569] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.191747] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.191981] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.191981] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.192152] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.192217] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.192265] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff72da15-0579-4c17-8921-0de51b66ecbf',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.528563] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea14cdbb-36fa-47a7-8e0f-957145b054ef: rpc.has_security_group_logging(os_id): False [ 1161.552434] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.552434] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.552434] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.552699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.552699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.552872] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.552972] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.553054] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.553201] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.553268] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.553360] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef is going to be updated. [ 1161.621216] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.621432] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.621432] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.621639] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.621799] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.635895] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef in Status: IN_PROGRESS for 2s [ 1161.651450] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d5b6c61f-b9c6-44e9-934b-c9925befabf7: rpc.has_security_group_logging(os_id): False [ 1161.673943] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.673943] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.673943] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.674276] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.674338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.674851] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.674851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.675031] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.675162] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.675283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.675412] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 is going to be updated. [ 1161.697289] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.697442] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.697486] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.697840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.697840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.698105] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.698105] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.698105] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.698272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.698618] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.698618] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff72da15-0579-4c17-8921-0de51b66ecbf is going to be updated. [ 1161.782111] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.782417] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.782527] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.782747] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.782930] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.820223] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff72da15-0579-4c17-8921-0de51b66ecbf in Status: IN_PROGRESS for 2s [ 1161.844924] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.845252] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.845326] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.845719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.845897] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.869425] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 in Status: IN_PROGRESS for 2s [ 1163.658677] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef in Status: SUCCESS [ 1163.659254] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.833917] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff72da15-0579-4c17-8921-0de51b66ecbf in Status: SUCCESS [ 1163.833917] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff72da15-0579-4c17-8921-0de51b66ecbf deletion is rescheduled due to dependency. [ 1163.833917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.889612] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 in Status: SUCCESS [ 1163.889876] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.037425] env[65322]: INFO networking_nsxv3.common.synchronization [req-32d87e38-9b11-4003-8f17-bbbc9716f995 req-24b907a2-f779-45d5-a737-31bb6ef83c3f tempest-AttachVolumeNegativeTest-885508175 tempest-AttachVolumeNegativeTest-885508175-project-member] Enqueued Resource ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac with Priority: HIGHEST for action security_group_members [ 1165.037425] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac with Priority: HIGHEST for action security_group_members [ 1165.037425] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-102dbac2-73ae-49a6-b7c8-8cf31712d5ac taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.037425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.037425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.037425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.037933] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.037933] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.037933] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.037933] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.037933] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.037933] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('102dbac2-73ae-49a6-b7c8-8cf31712d5ac',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.542305] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.542305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.542305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.542305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.542305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.542305] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.542305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.542305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.542305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.542305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.542305] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac is going to be updated. [ 1165.579193] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.579193] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.579193] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.579193] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.579193] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.589528] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac in Status: IN_PROGRESS for 2s [ 1165.930093] env[65322]: INFO networking_nsxv3.common.synchronization [None req-528a33d3-2750-48e0-b95e-dad8177ea4eb tempest-AttachInterfacesTestJSON-353803948 tempest-AttachInterfacesTestJSON-353803948-project-member] Enqueued Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 1165.930651] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 1165.930990] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.931160] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.931229] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.931435] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.931605] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.931712] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.931775] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.931924] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.932024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.934826] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.437797] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.438148] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.438148] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.438272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.438366] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.438619] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.438695] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.438737] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.438878] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.438956] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.439059] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 is going to be updated. [ 1166.473113] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.473113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.473113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.473113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.473113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.485701] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: IN_PROGRESS for 2s [ 1167.604342] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac in Status: SUCCESS [ 1167.605123] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac deletion is rescheduled due to dependency. [ 1167.605123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.496131] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: SUCCESS [ 1168.496253] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 deletion is rescheduled due to dependency. [ 1168.496368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.931742] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1170.931742] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1172.804650] env[65322]: INFO networking_nsxv3.common.synchronization [req-69fa3c98-747c-4cdc-abcb-9239b2f78fba req-09054df7-8b01-4bec-af82-cd0c59af6b6f tempest-DeleteServersTestJSON-1463403857 tempest-DeleteServersTestJSON-1463403857-project-member] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 1172.805300] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGHEST for action security_group_members [ 1172.805670] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.805770] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.805770] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.805965] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.806120] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.806214] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.806272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.806686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.806686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.806686] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.311173] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.311459] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.311459] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.311702] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.311702] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.311916] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.312073] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.312162] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.312257] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.312329] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.312410] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be updated. [ 1173.344222] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.344499] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.344499] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.344736] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.344883] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.354114] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: IN_PROGRESS for 2s [ 1175.368227] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 in Status: SUCCESS [ 1175.368726] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 deletion is rescheduled due to dependency. [ 1175.368726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.806896] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1177.807192] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1179.629135] env[65322]: INFO networking_nsxv3.common.synchronization [req-02536d5b-edd1-4c5e-922f-f014c57a0826 req-67d94f3a-920b-4518-8f91-84a00ae2799d tempest-AttachVolumeNegativeTest-885508175 tempest-AttachVolumeNegativeTest-885508175-project-member] Enqueued Resource ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 with Priority: HIGHEST for action security_group_members [ 1179.629691] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 with Priority: HIGHEST for action security_group_members [ 1179.630023] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ce3cc37-b73f-4ecb-b24a-2b06775793e8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.630151] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.630217] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.630466] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.630588] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.630690] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.630754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.630895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.630981] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.631085] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ce3cc37-b73f-4ecb-b24a-2b06775793e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.134364] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.134364] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.134364] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.134601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.134710] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.134975] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.135112] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.135112] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.135281] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.135281] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.135359] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 is going to be updated. [ 1180.238361] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.238548] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.238639] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.238977] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.239171] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.255366] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 in Status: IN_PROGRESS for 2s [ 1182.269326] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 in Status: SUCCESS [ 1182.270326] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 deletion is rescheduled due to dependency. [ 1182.270326] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.424630] env[65322]: INFO networking_nsxv3.common.synchronization [None req-8d37e3f2-340e-4e9d-b0e0-6d5895fae09b None None] Enqueued Resource ID: 89996457-638c-4850-87fd-f1549cf39b71 with Priority: HIGHEST for action port [ 1182.425201] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89996457-638c-4850-87fd-f1549cf39b71 with Priority: HIGHEST for action port [ 1182.425456] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-89996457-638c-4850-87fd-f1549cf39b71 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.425573] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89996457-638c-4850-87fd-f1549cf39b71" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.425636] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89996457-638c-4850-87fd-f1549cf39b71" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.425899] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89996457-638c-4850-87fd-f1549cf39b71" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.425974] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89996457-638c-4850-87fd-f1549cf39b71',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.724119] env[65322]: INFO networking_nsxv3.common.synchronization [req-4c515570-54d1-42b1-a2ae-eacd85e54653 req-ab6d3a6f-81d0-4873-b646-cc086a7a8614 tempest-ServerActionsTestJSON-71326710 tempest-ServerActionsTestJSON-71326710-project-member] Enqueued Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_members [ 1182.724699] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_members [ 1182.725248] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.727090] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.727090] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.728034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.728034] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.728034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.728232] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.728265] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.729029] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.729029] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.931409] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 89996457-638c-4850-87fd-f1549cf39b71 [ 1182.931640] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.931766] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.931831] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.932072] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.932162] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.932260] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:89996457-638c-4850-87fd-f1549cf39b71 already deleted. [ 1182.932332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89996457-638c-4850-87fd-f1549cf39b71" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.059234] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-896 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.059422] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.059543] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.059861] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.060287] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.060470] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.060598] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.060833] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.060976] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.061208] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1183.061325] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1183.061433] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1183.061890] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1183.061890] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1183.061890] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1183.061890] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1183.083475] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1183.083614] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1183.084320] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1183.084320] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.084320] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-38a17b55-7f04-4821-a133-2dfcc5a8bf2f taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.084522] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-38a17b55-7f04-4821-a133-2dfcc5a8bf2f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.084559] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-38a17b55-7f04-4821-a133-2dfcc5a8bf2f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.085023] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-38a17b55-7f04-4821-a133-2dfcc5a8bf2f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.085166] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38a17b55-7f04-4821-a133-2dfcc5a8bf2f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.231137] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.231137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.231137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.231137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.231446] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.231446] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.231592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.231592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.232510] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.232510] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.232510] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d is going to be updated. [ 1183.261269] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.261477] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.261477] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.261732] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.261831] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.271416] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: IN_PROGRESS for 2s [ 1183.591134] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.591134] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.591134] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.591134] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.591365] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.591365] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 38a17b55-7f04-4821-a133-2dfcc5a8bf2f not found, creating... [ 1183.592097] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.592097] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.592097] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.592097] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.592292] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.593171] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.593171] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.593171] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.593171] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.594172] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.594172] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 38a17b55-7f04-4821-a133-2dfcc5a8bf2f is going to be created. [ 1183.617699] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.617929] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.618697] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.618697] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.618697] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.618878] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-38a17b55-7f04-4821-a133-2dfcc5a8bf2f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.395063] env[65322]: INFO networking_nsxv3.common.synchronization [req-d70fc525-7e87-440f-8f3a-cffdc8ccf77d req-ae245615-5610-4451-a87f-c931f2b35cb3 service nova] Enqueued Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_rules [ 1184.395322] env[65322]: INFO networking_nsxv3.common.synchronization [req-d70fc525-7e87-440f-8f3a-cffdc8ccf77d req-ae245615-5610-4451-a87f-c931f2b35cb3 service nova] Enqueued Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 1184.397339] env[65322]: INFO networking_nsxv3.common.synchronization [req-d70fc525-7e87-440f-8f3a-cffdc8ccf77d req-ae245615-5610-4451-a87f-c931f2b35cb3 service nova] Enqueued Resource ID: 38a17b55-7f04-4821-a133-2dfcc5a8bf2f with Priority: HIGHEST for action port [ 1184.398075] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_rules [ 1184.398269] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 1184.398377] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38a17b55-7f04-4821-a133-2dfcc5a8bf2f with Priority: HIGHEST for action port [ 1184.398663] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.398786] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.398894] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.399097] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.399178] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.404442] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.404655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.404772] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.405023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.405235] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.405382] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.405486] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.405723] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.405908] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.406095] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.407174] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-38a17b55-7f04-4821-a133-2dfcc5a8bf2f taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.407389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38a17b55-7f04-4821-a133-2dfcc5a8bf2f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.407528] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38a17b55-7f04-4821-a133-2dfcc5a8bf2f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.408346] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38a17b55-7f04-4821-a133-2dfcc5a8bf2f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.408491] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38a17b55-7f04-4821-a133-2dfcc5a8bf2f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.739388] env[65322]: INFO networking_nsxv3.common.synchronization [None req-3e433bff-65d8-4fe1-859b-076276897cf3 tempest-AttachVolumeNegativeTest-885508175 tempest-AttachVolumeNegativeTest-885508175-project-member] Enqueued Resource ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 with Priority: HIGHEST for action security_group_rules [ 1184.739893] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 with Priority: HIGHEST for action security_group_rules [ 1184.740455] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad7e9873-1803-4fdd-9baa-f4ca5d792011 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.741457] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.741614] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.742063] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.742063] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad7e9873-1803-4fdd-9baa-f4ca5d792011',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.834489] env[65322]: INFO networking_nsxv3.common.synchronization [None req-d168c563-6aab-40aa-89f1-163abb74bafd tempest-AttachVolumeNegativeTest-885508175 tempest-AttachVolumeNegativeTest-885508175-project-member] Enqueued Resource ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 with Priority: HIGHEST for action security_group_rules [ 1184.835100] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 with Priority: HIGHEST for action security_group_rules [ 1184.835439] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad7e9873-1803-4fdd-9baa-f4ca5d792011 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.835545] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.910486] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.911792] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.911792] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.911792] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38a17b55-7f04-4821-a133-2dfcc5a8bf2f with status ACTIVE [ 1184.911980] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.912084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.912180] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.912334] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.912420] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.912600] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.912682] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.912737] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.913119] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.913119] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.913119] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.913251] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.913286] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.913959] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.913959] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.913959] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38a17b55-7f04-4821-a133-2dfcc5a8bf2f is going to be updated. [ 1184.936722] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.936722] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.936722] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.936722] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.936722] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.937038] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38a17b55-7f04-4821-a133-2dfcc5a8bf2f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.082793] env[65322]: INFO networking_nsxv3.common.synchronization [None req-949e35f5-fb7c-4fdc-ab10-17d549948f9c None None] Enqueued Resource ID: c6b1eca6-83d5-4de6-83f7-2ccdc287c405 with Priority: HIGHEST for action port [ 1185.083426] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6b1eca6-83d5-4de6-83f7-2ccdc287c405 with Priority: HIGHEST for action port [ 1185.083882] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6b1eca6-83d5-4de6-83f7-2ccdc287c405 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.084035] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6b1eca6-83d5-4de6-83f7-2ccdc287c405" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.084103] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6b1eca6-83d5-4de6-83f7-2ccdc287c405" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.084366] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6b1eca6-83d5-4de6-83f7-2ccdc287c405" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.084450] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6b1eca6-83d5-4de6-83f7-2ccdc287c405',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.265417] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.265621] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.265806] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.266136] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.266245] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.266366] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 already deleted. [ 1185.266455] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.266808] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.267226] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.267226] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad7e9873-1803-4fdd-9baa-f4ca5d792011',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.282753] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: SUCCESS [ 1185.282894] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d deletion is rescheduled due to dependency. [ 1185.283969] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.416136] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.590022] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c6b1eca6-83d5-4de6-83f7-2ccdc287c405 [ 1185.590022] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.590022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.590022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.590022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.590022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.590022] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c6b1eca6-83d5-4de6-83f7-2ccdc287c405 already deleted. [ 1185.590022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6b1eca6-83d5-4de6-83f7-2ccdc287c405" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.797321] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.797465] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.797537] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.797796] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.797889] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.798023] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 already deleted. [ 1185.798080] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.918365] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.918567] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.918567] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.918784] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.918873] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.918996] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 is going to be updated. [ 1185.949338] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.949550] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.949550] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.949748] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.949889] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.958937] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: IN_PROGRESS for 2s [ 1187.971141] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: SUCCESS [ 1187.971783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.971783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.971783] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.971876] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.971954] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.971986] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.972148] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.972231] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.972313] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.972402] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.441712] env[65322]: INFO networking_nsxv3.common.synchronization [req-4df46a33-dcb5-4629-9279-ee4baae456fb req-35348a0a-5378-4c7e-a859-197e44aa2116 tempest-ListServersNegativeTestJSON-2061010216 tempest-ListServersNegativeTestJSON-2061010216-project-member] Enqueued Resource ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e with Priority: HIGHEST for action security_group_members [ 1188.442241] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e with Priority: HIGHEST for action security_group_members [ 1188.442862] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4de1f800-ea47-4650-a9e7-e7000fa25d0e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.442862] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.442862] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.443272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.443432] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.443541] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.443789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.443958] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.444239] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.444239] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.478116] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.478116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.478116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.478116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.478116] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.478116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.478116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.478116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.478116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.478116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.478116] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.478116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.478116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.478116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.478116] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.478116] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.478677] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.478677] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.478677] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.478677] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.478677] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.773345] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-770 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.773575] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-770" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.773652] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-770" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.774776] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-770" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.774776] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.774776] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.774776] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.774948] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.775056] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.775223] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1188.775335] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1188.775490] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1188.775620] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1188.775759] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1188.775882] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1188.776022] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1188.794867] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1188.795710] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1188.795710] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1188.795710] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-770" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.795710] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-1a08a403-18c9-48cf-8f5f-8aa4a0b21a80 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.795928] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-1a08a403-18c9-48cf-8f5f-8aa4a0b21a80" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.795928] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-1a08a403-18c9-48cf-8f5f-8aa4a0b21a80" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.796264] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-1a08a403-18c9-48cf-8f5f-8aa4a0b21a80" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.796407] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a08a403-18c9-48cf-8f5f-8aa4a0b21a80',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.947536] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.947685] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.947770] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.948076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.948167] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.948353] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.948691] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.948691] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.948691] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.948837] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.948837] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e already deleted. [ 1188.948945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.981170] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06de8ea8-08fd-4206-a96b-fafa1c856867: rpc.has_security_group_logging(os_id): False [ 1188.998451] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.998655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.998655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.998853] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.998946] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.999176] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.999279] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.999341] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.999540] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.999626] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.999824] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.999917] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.999976] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.000140] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.000211] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.000391] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.000504] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.000565] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.000707] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.000780] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.000864] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 is going to be updated. [ 1189.063428] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.063636] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.063636] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.063788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.063933] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.074849] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: IN_PROGRESS for 2s [ 1189.299417] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.299676] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.299883] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.300259] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.300425] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.300607] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 1a08a403-18c9-48cf-8f5f-8aa4a0b21a80 not found, creating... [ 1189.300895] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.301222] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.301381] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.301635] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.301785] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.302075] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.302230] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.302342] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.302567] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.302726] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.302866] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 1a08a403-18c9-48cf-8f5f-8aa4a0b21a80 is going to be created. [ 1189.324558] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.324757] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.324878] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.325172] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.325401] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.325665] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-1a08a403-18c9-48cf-8f5f-8aa4a0b21a80" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.038512] env[65322]: INFO networking_nsxv3.common.synchronization [req-4df46a33-dcb5-4629-9279-ee4baae456fb req-db4a819e-0541-4d2c-8641-ca5dc407b87f service nova] Enqueued Resource ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e with Priority: HIGHEST for action security_group_rules [ 1190.038883] env[65322]: INFO networking_nsxv3.common.synchronization [req-4df46a33-dcb5-4629-9279-ee4baae456fb req-db4a819e-0541-4d2c-8641-ca5dc407b87f service nova] Enqueued Resource ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e with Priority: HIGHEST for action security_group_members [ 1190.038883] env[65322]: INFO networking_nsxv3.common.synchronization [req-4df46a33-dcb5-4629-9279-ee4baae456fb req-db4a819e-0541-4d2c-8641-ca5dc407b87f service nova] Enqueued Resource ID: 1a08a403-18c9-48cf-8f5f-8aa4a0b21a80 with Priority: HIGHEST for action port [ 1190.039461] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e with Priority: HIGHEST for action security_group_rules [ 1190.039461] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e with Priority: HIGHEST for action security_group_members [ 1190.039537] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a08a403-18c9-48cf-8f5f-8aa4a0b21a80 with Priority: HIGHEST for action port [ 1190.039749] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4de1f800-ea47-4650-a9e7-e7000fa25d0e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.039864] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.039926] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.040252] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.040288] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.041098] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4de1f800-ea47-4650-a9e7-e7000fa25d0e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.041214] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.041290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.041443] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.041813] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.041813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.041813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.043234] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.043234] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.043234] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.043234] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a08a403-18c9-48cf-8f5f-8aa4a0b21a80 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.043234] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a08a403-18c9-48cf-8f5f-8aa4a0b21a80" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.043418] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a08a403-18c9-48cf-8f5f-8aa4a0b21a80" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.043483] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a08a403-18c9-48cf-8f5f-8aa4a0b21a80" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.043568] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a08a403-18c9-48cf-8f5f-8aa4a0b21a80',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.544895] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.545989] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4de1f800-ea47-4650-a9e7-e7000fa25d0e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.546161] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.546456] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a08a403-18c9-48cf-8f5f-8aa4a0b21a80 with status ACTIVE [ 1190.546456] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.546615] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.546615] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.546879] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.546966] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.547147] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.547222] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.547361] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.547440] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.547638] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.547873] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.547974] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.548037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.548185] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.548263] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.548350] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a08a403-18c9-48cf-8f5f-8aa4a0b21a80 is going to be updated. [ 1190.571569] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.571775] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.571775] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.571984] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.572140] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.572299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a08a403-18c9-48cf-8f5f-8aa4a0b21a80" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.691196] env[65322]: INFO networking_nsxv3.common.synchronization [req-4df46a33-dcb5-4629-9279-ee4baae456fb req-555a6eae-adcd-4d63-8295-61c488a87e31 tempest-ListServersNegativeTestJSON-2061010216 tempest-ListServersNegativeTestJSON-2061010216-project-member] Enqueued Resource ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e with Priority: HIGHEST for action security_group_members [ 1190.691730] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e with Priority: HIGHEST for action security_group_members [ 1190.692067] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4de1f800-ea47-4650-a9e7-e7000fa25d0e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.692171] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.016459] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-770 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.016670] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-770" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.016811] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-770" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.017190] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-770" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.017506] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.017666] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.017775] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.018018] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.018905] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.018905] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1191.018905] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1191.018905] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1191.018905] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1191.018905] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1191.019148] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1191.019148] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1191.041021] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1191.041297] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1191.041353] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1191.041486] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-770" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.041795] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-70e73747-6ecd-4764-a615-5ea7735f306a taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.041959] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-70e73747-6ecd-4764-a615-5ea7735f306a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.042084] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-70e73747-6ecd-4764-a615-5ea7735f306a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.042425] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-70e73747-6ecd-4764-a615-5ea7735f306a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.042558] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70e73747-6ecd-4764-a615-5ea7735f306a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.050311] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.088320] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: SUCCESS [ 1191.088533] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.544787] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.545040] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.545174] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.545538] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.545789] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.546075] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 70e73747-6ecd-4764-a615-5ea7735f306a not found, creating... [ 1191.546492] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.546775] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.546974] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.547254] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.547400] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.547751] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.547963] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.548139] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.548358] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.548532] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.548687] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 70e73747-6ecd-4764-a615-5ea7735f306a is going to be created. [ 1191.553618] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.553782] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.553837] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.554017] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.554111] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.554232] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e is going to be created. [ 1191.574216] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.574443] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.574542] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.574843] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.575088] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.575316] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-70e73747-6ecd-4764-a615-5ea7735f306a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.579388] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.579544] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.579587] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.579762] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.579910] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.589016] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e in Status: UNINITIALIZED for 2s [ 1192.310633] env[65322]: INFO networking_nsxv3.common.synchronization [req-4df46a33-dcb5-4629-9279-ee4baae456fb req-497e198c-3f5e-4856-8973-0ac9b678ab95 service nova] Enqueued Resource ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e with Priority: HIGHEST for action security_group_rules [ 1192.310963] env[65322]: INFO networking_nsxv3.common.synchronization [req-4df46a33-dcb5-4629-9279-ee4baae456fb req-497e198c-3f5e-4856-8973-0ac9b678ab95 service nova] Enqueued Resource ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e with Priority: HIGHEST for action security_group_members [ 1192.310963] env[65322]: INFO networking_nsxv3.common.synchronization [req-4df46a33-dcb5-4629-9279-ee4baae456fb req-497e198c-3f5e-4856-8973-0ac9b678ab95 service nova] Enqueued Resource ID: 70e73747-6ecd-4764-a615-5ea7735f306a with Priority: HIGHEST for action port [ 1192.311656] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e with Priority: HIGHEST for action security_group_rules [ 1192.311720] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e with Priority: HIGHEST for action security_group_members [ 1192.311792] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70e73747-6ecd-4764-a615-5ea7735f306a with Priority: HIGHEST for action port [ 1192.312104] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4de1f800-ea47-4650-a9e7-e7000fa25d0e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.312265] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.312437] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4de1f800-ea47-4650-a9e7-e7000fa25d0e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.312520] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.312715] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-70e73747-6ecd-4764-a615-5ea7735f306a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.312812] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70e73747-6ecd-4764-a615-5ea7735f306a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.312873] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70e73747-6ecd-4764-a615-5ea7735f306a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.313206] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70e73747-6ecd-4764-a615-5ea7735f306a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.313290] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70e73747-6ecd-4764-a615-5ea7735f306a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.818425] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70e73747-6ecd-4764-a615-5ea7735f306a with status ACTIVE [ 1192.818425] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.818660] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.818660] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.818780] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.818842] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.819110] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.819266] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.819338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.819513] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.819897] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.819897] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.819897] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.820068] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.820097] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.820160] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.820243] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70e73747-6ecd-4764-a615-5ea7735f306a is going to be updated. [ 1192.841952] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.842206] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.842268] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.842446] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.842579] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.843009] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70e73747-6ecd-4764-a615-5ea7735f306a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.037151] env[65322]: INFO networking_nsxv3.common.synchronization [req-4df46a33-dcb5-4629-9279-ee4baae456fb req-62e4842f-fb31-4e69-bf7a-ef2cee8b6563 tempest-ListServersNegativeTestJSON-2061010216 tempest-ListServersNegativeTestJSON-2061010216-project-member] Enqueued Resource ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e with Priority: HIGHEST for action security_group_members [ 1193.037720] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e with Priority: HIGHEST for action security_group_members [ 1193.038051] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4de1f800-ea47-4650-a9e7-e7000fa25d0e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.038151] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.338806] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-770 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.338806] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-770" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.339225] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-770" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.339265] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-770" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.339658] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.339777] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.340451] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.340451] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.340451] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.340451] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1193.340614] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1193.340614] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1193.340715] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1193.340829] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1193.341092] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1193.341092] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1193.361705] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1193.361820] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1193.362568] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1193.362568] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-770" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.362568] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-40c13875-458d-4c1a-93a3-7c181dac84ee taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.363564] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-40c13875-458d-4c1a-93a3-7c181dac84ee" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.363564] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-40c13875-458d-4c1a-93a3-7c181dac84ee" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.363564] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-40c13875-458d-4c1a-93a3-7c181dac84ee" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.363564] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40c13875-458d-4c1a-93a3-7c181dac84ee',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.600415] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e in Status: SUCCESS [ 1193.600579] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.600753] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.600968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.601280] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.601474] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.601599] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.601833] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.601923] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.602038] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.602141] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.602975] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.603183] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.603350] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.603460] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.603522] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.603679] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.603764] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.603847] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.865458] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.865682] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.865811] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.866110] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.866259] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.866412] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 40c13875-458d-4c1a-93a3-7c181dac84ee not found, creating... [ 1193.866668] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.866852] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.866969] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.867202] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.867335] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.867613] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.867763] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.867875] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.868098] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.868228] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.868363] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 40c13875-458d-4c1a-93a3-7c181dac84ee is going to be created. [ 1193.888216] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.888471] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.888594] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.888864] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.889158] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.889380] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-40c13875-458d-4c1a-93a3-7c181dac84ee" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.106063] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.107170] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4de1f800-ea47-4650-a9e7-e7000fa25d0e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.107356] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.608871] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.638602] env[65322]: INFO networking_nsxv3.common.synchronization [req-4df46a33-dcb5-4629-9279-ee4baae456fb req-9d46a91a-5904-40d8-b0f3-e780cf1a31ec service nova] Enqueued Resource ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e with Priority: HIGHEST for action security_group_rules [ 1194.638775] env[65322]: INFO networking_nsxv3.common.synchronization [req-4df46a33-dcb5-4629-9279-ee4baae456fb req-9d46a91a-5904-40d8-b0f3-e780cf1a31ec service nova] Enqueued Resource ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e with Priority: HIGHEST for action security_group_members [ 1194.638908] env[65322]: INFO networking_nsxv3.common.synchronization [req-4df46a33-dcb5-4629-9279-ee4baae456fb req-9d46a91a-5904-40d8-b0f3-e780cf1a31ec service nova] Enqueued Resource ID: 40c13875-458d-4c1a-93a3-7c181dac84ee with Priority: HIGHEST for action port [ 1194.639199] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e with Priority: HIGHEST for action security_group_rules [ 1194.639271] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e with Priority: HIGHEST for action security_group_members [ 1194.639364] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40c13875-458d-4c1a-93a3-7c181dac84ee with Priority: HIGHEST for action port [ 1194.639895] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4de1f800-ea47-4650-a9e7-e7000fa25d0e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.640010] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.640211] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4de1f800-ea47-4650-a9e7-e7000fa25d0e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.640294] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.640499] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-40c13875-458d-4c1a-93a3-7c181dac84ee taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.640613] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40c13875-458d-4c1a-93a3-7c181dac84ee" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.640701] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40c13875-458d-4c1a-93a3-7c181dac84ee" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.640859] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40c13875-458d-4c1a-93a3-7c181dac84ee" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.640940] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40c13875-458d-4c1a-93a3-7c181dac84ee',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.111888] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.112061] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.112061] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.112286] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.112381] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.112491] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e is going to be updated. [ 1195.143385] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40c13875-458d-4c1a-93a3-7c181dac84ee with status ACTIVE [ 1195.143617] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.143756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.143826] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.144070] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.144149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.144333] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.144435] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.144498] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.144653] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.144728] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.144908] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.144998] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.145072] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.145209] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.145280] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.145364] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40c13875-458d-4c1a-93a3-7c181dac84ee is going to be updated. [ 1195.182331] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.182519] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.182565] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.182756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.182980] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.185604] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.185727] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.185828] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.186495] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.186495] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.186495] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40c13875-458d-4c1a-93a3-7c181dac84ee" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.192722] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e in Status: IN_PROGRESS for 2s [ 1195.396774] env[65322]: INFO networking_nsxv3.common.synchronization [req-dfd0d656-3aaf-4014-9459-4b44b8c72187 req-47db930f-5e83-404b-b7be-47257747abcb tempest-AttachVolumeNegativeTest-885508175 tempest-AttachVolumeNegativeTest-885508175-project-member] Enqueued Resource ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 with Priority: HIGHEST for action security_group_members [ 1195.397381] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 with Priority: HIGHEST for action security_group_members [ 1195.397733] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad7e9873-1803-4fdd-9baa-f4ca5d792011 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.397950] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.398024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.398305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.398473] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.398581] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.398661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.398856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.402020] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.402020] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad7e9873-1803-4fdd-9baa-f4ca5d792011',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.769812] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-318 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.770172] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-318" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.770172] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-318" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.770454] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-318" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.770745] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.770917] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.771234] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.771518] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.771687] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.771911] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1195.772483] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1195.772483] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1195.772483] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1195.772483] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1195.772483] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1195.772940] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1195.796472] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1195.796697] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1195.796918] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1195.797159] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-318" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.797801] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-3bc4efec-5434-4833-8521-3df1f9914c7a taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.797801] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-3bc4efec-5434-4833-8521-3df1f9914c7a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.797927] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-3bc4efec-5434-4833-8521-3df1f9914c7a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.798288] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-3bc4efec-5434-4833-8521-3df1f9914c7a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.799014] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bc4efec-5434-4833-8521-3df1f9914c7a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.901856] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.902049] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.902112] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.902408] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.902502] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.902735] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.902837] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.902898] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.903105] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.903184] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.903272] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 already deleted. [ 1195.903360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.301041] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.301533] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.301949] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.302331] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.302572] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.302784] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 3bc4efec-5434-4833-8521-3df1f9914c7a not found, creating... [ 1196.303241] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.303489] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.303653] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.304038] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.304280] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.304823] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.305074] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.305219] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.305548] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.305730] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.305935] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 3bc4efec-5434-4833-8521-3df1f9914c7a is going to be created. [ 1196.330211] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.330449] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.330579] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.331047] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.331514] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.331780] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-3bc4efec-5434-4833-8521-3df1f9914c7a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.047317] env[65322]: INFO networking_nsxv3.common.synchronization [req-dfd0d656-3aaf-4014-9459-4b44b8c72187 req-0fe8710d-9803-4567-a64a-50449a641585 service nova] Enqueued Resource ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 with Priority: HIGHEST for action security_group_rules [ 1197.047317] env[65322]: INFO networking_nsxv3.common.synchronization [req-dfd0d656-3aaf-4014-9459-4b44b8c72187 req-0fe8710d-9803-4567-a64a-50449a641585 service nova] Enqueued Resource ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 with Priority: HIGHEST for action security_group_members [ 1197.047317] env[65322]: INFO networking_nsxv3.common.synchronization [req-dfd0d656-3aaf-4014-9459-4b44b8c72187 req-0fe8710d-9803-4567-a64a-50449a641585 service nova] Enqueued Resource ID: 3bc4efec-5434-4833-8521-3df1f9914c7a with Priority: HIGHEST for action port [ 1197.047909] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 with Priority: HIGHEST for action security_group_rules [ 1197.047909] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 with Priority: HIGHEST for action security_group_members [ 1197.047909] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bc4efec-5434-4833-8521-3df1f9914c7a with Priority: HIGHEST for action port [ 1197.048205] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad7e9873-1803-4fdd-9baa-f4ca5d792011 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.048340] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.048580] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.048698] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.048698] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad7e9873-1803-4fdd-9baa-f4ca5d792011',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.049870] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad7e9873-1803-4fdd-9baa-f4ca5d792011 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.052985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.052985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.052985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.052985] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.052985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.052985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.052985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.052985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.052985] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad7e9873-1803-4fdd-9baa-f4ca5d792011',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.053775] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bc4efec-5434-4833-8521-3df1f9914c7a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.053775] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bc4efec-5434-4833-8521-3df1f9914c7a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.053775] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bc4efec-5434-4833-8521-3df1f9914c7a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.053943] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bc4efec-5434-4833-8521-3df1f9914c7a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.053943] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bc4efec-5434-4833-8521-3df1f9914c7a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.205836] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e in Status: IN_PROGRESS for 4s [ 1197.561680] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ad7e9873-1803-4fdd-9baa-f4ca5d792011',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.561680] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad7e9873-1803-4fdd-9baa-f4ca5d792011 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.561680] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.561680] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3bc4efec-5434-4833-8521-3df1f9914c7a with status ACTIVE [ 1197.561680] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.561680] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.561680] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.561680] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.561680] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.561680] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.561680] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.562699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.562931] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.563043] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.563436] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.563436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.563436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.564639] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.564639] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.564639] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3bc4efec-5434-4833-8521-3df1f9914c7a is going to be updated. [ 1197.602824] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.603115] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.603115] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.603459] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.603459] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.603825] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bc4efec-5434-4833-8521-3df1f9914c7a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.755099] env[65322]: INFO networking_nsxv3.common.synchronization [req-de6126b8-5335-478b-8c7a-f621b717e626 req-7a07765e-2018-42af-b356-656f78e4455a tempest-ServerActionsTestJSON-71326710 tempest-ServerActionsTestJSON-71326710-project-member] Enqueued Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_members [ 1197.755792] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_members [ 1197.757144] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.757303] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.757382] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.757574] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.757763] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.757860] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.757924] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.758151] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.758186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.758281] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.059206] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ad7e9873-1803-4fdd-9baa-f4ca5d792011',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.104829] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-710 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.105073] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.105214] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.105487] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.105830] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.105995] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.106123] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.106351] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.106494] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.106701] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1198.106860] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1198.106968] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1198.107111] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1198.107196] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1198.107323] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1198.107425] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1198.130579] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1198.130753] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1198.130893] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1198.131080] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.131400] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-56ce5174-efdd-4cb6-bedc-c2c767af2caa taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.131570] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-56ce5174-efdd-4cb6-bedc-c2c767af2caa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.131687] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-56ce5174-efdd-4cb6-bedc-c2c767af2caa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.132040] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-56ce5174-efdd-4cb6-bedc-c2c767af2caa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.132194] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56ce5174-efdd-4cb6-bedc-c2c767af2caa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.264050] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.264723] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.264723] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.264723] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.264723] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.264971] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.265051] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.265136] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.265299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.265376] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.266860] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d is going to be updated. [ 1198.307541] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.307928] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.308135] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.308534] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.308945] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.321621] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: IN_PROGRESS for 2s [ 1198.562294] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.562465] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.562584] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.562718] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.562856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.562894] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 is going to be created. [ 1198.587485] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.587759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.587759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.587985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.588101] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.597937] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 in Status: UNINITIALIZED for 2s [ 1198.634701] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.634975] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.635082] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.635331] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.635478] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.635636] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 56ce5174-efdd-4cb6-bedc-c2c767af2caa not found, creating... [ 1198.635940] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.636148] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.636272] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.636547] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.636684] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.637014] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.637228] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.637353] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.637570] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.637703] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.637878] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 56ce5174-efdd-4cb6-bedc-c2c767af2caa is going to be created. [ 1198.658919] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.659199] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.659326] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.659594] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.659817] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.660083] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-56ce5174-efdd-4cb6-bedc-c2c767af2caa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.215824] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e in Status: SUCCESS [ 1199.216355] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.216511] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.216854] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.217137] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.217343] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.217457] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.217699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.217838] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.218024] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.417941] env[65322]: INFO networking_nsxv3.common.synchronization [req-de6126b8-5335-478b-8c7a-f621b717e626 req-6fe2210a-b528-4e02-9d42-e232f21b31ba service nova] Enqueued Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_rules [ 1199.418100] env[65322]: INFO networking_nsxv3.common.synchronization [req-de6126b8-5335-478b-8c7a-f621b717e626 req-6fe2210a-b528-4e02-9d42-e232f21b31ba service nova] Enqueued Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_members [ 1199.418256] env[65322]: INFO networking_nsxv3.common.synchronization [req-de6126b8-5335-478b-8c7a-f621b717e626 req-6fe2210a-b528-4e02-9d42-e232f21b31ba service nova] Enqueued Resource ID: 56ce5174-efdd-4cb6-bedc-c2c767af2caa with Priority: HIGHEST for action port [ 1199.420430] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_rules [ 1199.420639] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_members [ 1199.420718] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56ce5174-efdd-4cb6-bedc-c2c767af2caa with Priority: HIGHEST for action port [ 1199.421112] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.421267] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.421335] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.421544] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.421626] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.422688] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.422786] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.426272] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-56ce5174-efdd-4cb6-bedc-c2c767af2caa taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.427790] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56ce5174-efdd-4cb6-bedc-c2c767af2caa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.427790] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56ce5174-efdd-4cb6-bedc-c2c767af2caa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.427790] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56ce5174-efdd-4cb6-bedc-c2c767af2caa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.427790] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56ce5174-efdd-4cb6-bedc-c2c767af2caa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.720483] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.777060] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-896 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.777404] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.777604] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.777983] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.778394] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.778567] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.778725] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.779013] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.779262] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.779507] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1199.779664] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1199.779833] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1199.779955] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1199.780081] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1199.780203] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1199.780363] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1199.800184] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1199.800394] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1199.800568] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1199.800773] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-896" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.801171] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-38a17b55-7f04-4821-a133-2dfcc5a8bf2f taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.801373] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-38a17b55-7f04-4821-a133-2dfcc5a8bf2f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.801525] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-38a17b55-7f04-4821-a133-2dfcc5a8bf2f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.801805] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-38a17b55-7f04-4821-a133-2dfcc5a8bf2f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.801962] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38a17b55-7f04-4821-a133-2dfcc5a8bf2f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.929931] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.930104] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.930590] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56ce5174-efdd-4cb6-bedc-c2c767af2caa with status ACTIVE [ 1199.930590] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.930776] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.930776] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.930890] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.930979] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.931187] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.931285] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.931344] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.931502] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.931577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.931778] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.931872] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.931930] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.932085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.932160] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.932245] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56ce5174-efdd-4cb6-bedc-c2c767af2caa is going to be updated. [ 1199.957622] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.957815] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.957901] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.958170] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.958335] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.958513] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56ce5174-efdd-4cb6-bedc-c2c767af2caa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.222852] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.304957] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.305289] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.305447] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.305789] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.305995] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.306386] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.306601] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.306802] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.307109] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.307309] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.307645] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.307846] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.308031] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.308257] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.308404] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.308580] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 38a17b55-7f04-4821-a133-2dfcc5a8bf2f is going to be updated. [ 1200.337728] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: SUCCESS [ 1200.337952] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d deletion is rescheduled due to dependency. [ 1200.338080] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.338250] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.338507] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.338692] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.338811] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.338879] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.339061] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.339160] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.339263] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.349288] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.349607] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.349743] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.350063] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.350280] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.350555] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-38a17b55-7f04-4821-a133-2dfcc5a8bf2f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.608629] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 in Status: SUCCESS [ 1200.611785] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.611785] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.611785] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.611785] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.611785] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.611785] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.611785] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.611785] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.611785] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.611785] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ad7e9873-1803-4fdd-9baa-f4ca5d792011',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.725095] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.725331] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.725331] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.725526] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.725622] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.725730] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e is going to be updated. [ 1200.756535] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.756827] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.756827] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.757068] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.757223] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.767474] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e in Status: IN_PROGRESS for 2s [ 1200.841633] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.042815] env[65322]: INFO networking_nsxv3.common.synchronization [req-23de2dd2-b2d1-425e-9a25-327482c6a7c0 req-5b5ea6a9-6525-4c06-9ebd-b0f0fa8082ee service nova] Enqueued Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_rules [ 1201.043051] env[65322]: INFO networking_nsxv3.common.synchronization [req-23de2dd2-b2d1-425e-9a25-327482c6a7c0 req-5b5ea6a9-6525-4c06-9ebd-b0f0fa8082ee service nova] Enqueued Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 1201.043147] env[65322]: INFO networking_nsxv3.common.synchronization [req-23de2dd2-b2d1-425e-9a25-327482c6a7c0 req-5b5ea6a9-6525-4c06-9ebd-b0f0fa8082ee service nova] Enqueued Resource ID: 38a17b55-7f04-4821-a133-2dfcc5a8bf2f with Priority: HIGHEST for action port [ 1201.043727] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_rules [ 1201.043875] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 1201.043988] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38a17b55-7f04-4821-a133-2dfcc5a8bf2f with Priority: HIGHEST for action port [ 1201.044514] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.044605] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.044708] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.044981] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.045110] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.046385] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.046496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.046562] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.046860] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.048012] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.048012] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.048012] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.048012] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.048012] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.048012] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.048947] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-38a17b55-7f04-4821-a133-2dfcc5a8bf2f taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.048947] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38a17b55-7f04-4821-a133-2dfcc5a8bf2f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.048947] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38a17b55-7f04-4821-a133-2dfcc5a8bf2f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.049571] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38a17b55-7f04-4821-a133-2dfcc5a8bf2f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.049571] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38a17b55-7f04-4821-a133-2dfcc5a8bf2f',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.114815] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ad7e9873-1803-4fdd-9baa-f4ca5d792011',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.344317] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.551774] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.551774] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.552046] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.552984] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38a17b55-7f04-4821-a133-2dfcc5a8bf2f with status ACTIVE [ 1201.553199] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.553313] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.553400] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.554048] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.554048] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.554048] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.554048] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.554048] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.554359] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.554359] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.554590] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.554737] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.554845] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.555084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.555196] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.555334] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38a17b55-7f04-4821-a133-2dfcc5a8bf2f is going to be updated. [ 1201.580926] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.581179] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.581179] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.581391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.581527] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.581686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38a17b55-7f04-4821-a133-2dfcc5a8bf2f" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.617927] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ad7e9873-1803-4fdd-9baa-f4ca5d792011: rpc.has_security_group_logging(os_id): False [ 1201.643175] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.643475] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.643475] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.643600] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.643687] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.643960] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.644062] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.644131] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.644283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.644352] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.644443] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 is going to be created. [ 1201.725847] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.726624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.726719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.727052] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.727247] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.761302] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 in Status: IN_PROGRESS for 2s [ 1201.847293] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.847571] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.847571] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.847727] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.847813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.847943] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d is going to be updated. [ 1201.883545] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.883767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.883767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.884020] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.884296] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.894072] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: IN_PROGRESS for 2s [ 1202.057633] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.560522] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.560919] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.560919] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.561181] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.561322] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.561472] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 is going to be updated. [ 1202.592551] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.592746] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.592746] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.592954] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.593109] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.602850] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: IN_PROGRESS for 2s [ 1202.777255] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e in Status: SUCCESS [ 1202.777470] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.777630] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.777879] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.778178] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.778310] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.778374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.778535] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.778615] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.778708] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.281778] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.774687] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 in Status: SUCCESS [ 1203.775106] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.784807] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.906012] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: SUCCESS [ 1203.906342] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.906621] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.907075] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.907662] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.907662] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.907662] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.907947] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.908018] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.908151] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.908329] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.287296] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.287509] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.287592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.287828] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.287941] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.288069] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e is going to be updated. [ 1204.322105] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.322358] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.322423] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.322750] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.322984] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.333967] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e in Status: IN_PROGRESS for 2s [ 1204.410873] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.615185] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: SUCCESS [ 1204.615478] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.615718] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.616013] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.616256] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.616425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.616534] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.616742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.616885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.617184] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.617184] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.912964] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d: rpc.has_security_group_logging(os_id): False [ 1204.931802] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.932072] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.932072] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.932334] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.932450] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.932677] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.932868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.932973] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.933192] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.933249] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.933357] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d is going to be updated. [ 1205.008792] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.009077] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.009161] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.009428] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.009617] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.027730] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: IN_PROGRESS for 2s [ 1205.121621] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.121807] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.121883] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.122137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.122413] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.122602] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.122602] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.122764] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.122828] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.122959] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.123153] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.123259] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.123320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.123496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.123667] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.123789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.123890] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.124110] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.124201] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.124304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.124424] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.626629] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06de8ea8-08fd-4206-a96b-fafa1c856867: rpc.has_security_group_logging(os_id): False [ 1205.645696] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.645948] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.646033] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.646284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.646377] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.646595] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.646697] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.646754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.647076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.647188] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.647320] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.647437] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.647536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.647765] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.647992] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.648312] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.648422] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.648488] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.648750] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.648850] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.648950] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 is going to be updated. [ 1205.713143] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.713288] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.713356] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.713630] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.714537] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.732795] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: IN_PROGRESS for 2s [ 1206.045031] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1206.045031] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=7 [ 1206.320473] env[65322]: INFO networking_nsxv3.common.synchronization [req-0e68a46d-6fe4-4709-bec3-6123dd134404 req-f9c4f07d-de84-4225-bf8f-6f10afb26f38 tempest-ListServersNegativeTestJSON-2061010216 tempest-ListServersNegativeTestJSON-2061010216-project-member] Enqueued Resource ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e with Priority: HIGHEST for action security_group_members [ 1206.321163] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e with Priority: HIGHEST for action security_group_members [ 1206.321328] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4de1f800-ea47-4650-a9e7-e7000fa25d0e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.321499] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.343916] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e in Status: SUCCESS [ 1206.344450] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.344450] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.344748] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.344748] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.344886] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.344886] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.345053] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.345088] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.345161] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.345324] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4de1f800-ea47-4650-a9e7-e7000fa25d0e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.345405] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.345462] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.345608] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.345747] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.345844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.345901] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.346047] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.346120] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.346195] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.346286] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.348449] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.348449] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.350384] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.350384] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.350384] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.350384] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.350384] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.350384] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.848982] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4de1f800-ea47-4650-a9e7-e7000fa25d0e: rpc.has_security_group_logging(os_id): False [ 1206.851721] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.869492] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.869672] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.869720] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.869904] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.869995] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.870208] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.870339] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.870399] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.870554] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.870840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.870840] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.870966] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.870966] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.871113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.871184] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.871387] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.871498] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.871574] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.871733] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.871813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.871914] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e is going to be created. [ 1206.935328] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.935523] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.935523] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.935862] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.935999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.947436] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e in Status: IN_PROGRESS for 2s [ 1207.044181] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: SUCCESS [ 1207.044444] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.354549] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.746831] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: SUCCESS [ 1207.747072] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.857509] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.857509] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.857509] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.857872] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.857872] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.857872] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e is going to be updated. [ 1207.990827] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.991039] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.991089] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.991266] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.991404] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.001550] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e in Status: IN_PROGRESS for 2s [ 1208.962634] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e in Status: SUCCESS [ 1208.963040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.963040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.963327] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.963439] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.465545] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4de1f800-ea47-4650-a9e7-e7000fa25d0e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.465688] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.013559] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e in Status: SUCCESS [ 1210.013559] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.013559] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.014022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.014022] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.014180] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.014288] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.014553] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.014718] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.014862] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.517914] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.021360] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.119418] env[65322]: INFO networking_nsxv3.common.synchronization [req-300e5ca0-6236-4889-818f-97d50dc2a38b req-17ee2477-51b7-45c9-bfd4-557272546dfa tempest-AttachVolumeShelveTestJSON-315803451 tempest-AttachVolumeShelveTestJSON-315803451-project-member] Enqueued Resource ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 with Priority: HIGHEST for action security_group_members [ 1211.120033] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 with Priority: HIGHEST for action security_group_members [ 1211.120358] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-d5b6c61f-b9c6-44e9-934b-c9925befabf7 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.120564] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.120607] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.120781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.120950] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.121065] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.121128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.121280] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.121361] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.121455] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d5b6c61f-b9c6-44e9-934b-c9925befabf7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.526091] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.526091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.526091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.526091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.526091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.526091] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e is going to be updated. [ 1211.555537] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.555671] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.555862] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.555954] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.556128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.565456] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e in Status: IN_PROGRESS for 2s [ 1211.625141] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.625393] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.625393] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.625573] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.625668] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.625889] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.625993] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.626066] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.626262] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.626626] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.626626] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 is going to be updated. [ 1211.661080] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.661283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.661283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.661497] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.661630] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.671122] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 in Status: IN_PROGRESS for 2s [ 1213.577922] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e in Status: SUCCESS [ 1213.577922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.577922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.577922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.577922] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.577922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.577922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.577922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.577922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.577922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.577922] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.682177] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 in Status: SUCCESS [ 1213.682469] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 deletion is rescheduled due to dependency. [ 1213.682657] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.695625] env[65322]: INFO networking_nsxv3.common.synchronization [req-7f9f625e-2e54-44b1-906e-66fbdfea615f req-3f2ccc94-92cd-477b-a269-cd0ae6775fc5 tempest-ListServersNegativeTestJSON-2061010216 tempest-ListServersNegativeTestJSON-2061010216-project-member] Enqueued Resource ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e with Priority: HIGHEST for action security_group_members [ 1213.695870] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e with Priority: HIGHEST for action security_group_members [ 1213.696196] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4de1f800-ea47-4650-a9e7-e7000fa25d0e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.696309] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.696365] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.696561] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.696817] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.696817] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.697043] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.697349] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.697460] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.697555] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.825194] env[65322]: INFO networking_nsxv3.common.synchronization [req-42cdea92-a04a-4e7a-b792-eb7ae24fc31b req-52729972-2276-4ad0-b2e2-0a3bd76a0e4b tempest-ListServersNegativeTestJSON-2061010216 tempest-ListServersNegativeTestJSON-2061010216-project-member] Enqueued Resource ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e with Priority: HIGHEST for action security_group_members [ 1213.825585] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e with Priority: HIGHEST for action security_group_members [ 1213.825978] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4de1f800-ea47-4650-a9e7-e7000fa25d0e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.825978] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.080447] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4de1f800-ea47-4650-a9e7-e7000fa25d0e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.080653] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.202215] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.704369] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.207055] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.207241] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.207323] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.207575] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.207663] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.207772] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e is going to be updated. [ 1215.239964] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.240201] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.240316] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.240627] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.240850] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.250167] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e in Status: IN_PROGRESS for 2s [ 1216.091724] env[65322]: INFO networking_nsxv3.common.synchronization [req-c670739d-ec62-46b8-be0e-9dc1369bbf18 req-b52f520d-bbf9-4c7f-8e0c-b0229d6437b1 tempest-ServerActionsTestOtherA-1162989957 tempest-ServerActionsTestOtherA-1162989957-project-member] Enqueued Resource ID: e4dca03f-65fb-4951-910c-8904302d70fa with Priority: HIGHEST for action security_group_members [ 1216.092344] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4dca03f-65fb-4951-910c-8904302d70fa with Priority: HIGHEST for action security_group_members [ 1216.092620] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4dca03f-65fb-4951-910c-8904302d70fa taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.094479] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.094479] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.094479] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.094479] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.094479] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.094479] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.094479] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.094479] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.094479] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4dca03f-65fb-4951-910c-8904302d70fa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.598387] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4dca03f-65fb-4951-910c-8904302d70fa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.632586] env[65322]: INFO networking_nsxv3.common.synchronization [req-6a7647c4-de9c-4caf-bbf8-bdcfb46ab9e4 req-29e2065f-bb54-4f94-8188-740894d9970b tempest-AttachInterfacesTestJSON-353803948 tempest-AttachInterfacesTestJSON-353803948-project-member] Enqueued Resource ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef with Priority: HIGHEST for action security_group_members [ 1216.633102] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef with Priority: HIGHEST for action security_group_members [ 1216.633498] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea14cdbb-36fa-47a7-8e0f-957145b054ef taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.633598] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.633598] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.633788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.633938] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.634055] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.634110] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.634261] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.634338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.634431] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea14cdbb-36fa-47a7-8e0f-957145b054ef',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.100707] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4dca03f-65fb-4951-910c-8904302d70fa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.136708] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea14cdbb-36fa-47a7-8e0f-957145b054ef',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.261990] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e in Status: SUCCESS [ 1217.261990] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.261990] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.262655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.262655] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.262655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.262655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.262655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.262856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.262856] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.603334] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.603551] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.603551] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.603804] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.603881] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.603958] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4dca03f-65fb-4951-910c-8904302d70fa is going to be updated. [ 1217.639128] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea14cdbb-36fa-47a7-8e0f-957145b054ef',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.640924] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.641075] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.641146] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.641408] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.641579] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.651577] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4dca03f-65fb-4951-910c-8904302d70fa in Status: IN_PROGRESS for 2s [ 1217.693818] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-580 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.694061] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-580" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.694142] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-580" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.694430] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-580" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.695147] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.695324] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.695444] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.695666] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.695812] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.696032] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1217.696143] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1217.696249] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1217.696353] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1217.696456] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1217.696558] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1217.696684] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1217.720273] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1217.720444] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1217.720566] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1217.720745] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-580" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.721065] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-df1e4331-4fbb-4793-8312-f3ac29ecc291 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.721238] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-df1e4331-4fbb-4793-8312-f3ac29ecc291" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.721354] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-df1e4331-4fbb-4793-8312-f3ac29ecc291" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.721621] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-df1e4331-4fbb-4793-8312-f3ac29ecc291" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.721755] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df1e4331-4fbb-4793-8312-f3ac29ecc291',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.765105] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.765297] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.765336] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.765538] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.765634] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.765838] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.765934] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.765993] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.766147] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.766221] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.766331] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e is going to be updated. [ 1217.792415] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.792556] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.792626] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.792833] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.792967] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.802630] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e in Status: IN_PROGRESS for 2s [ 1218.143738] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.144123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.144123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.144225] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.144283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.144387] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef is going to be updated. [ 1218.171199] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.171448] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.171494] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.171951] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.172178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.182673] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef in Status: IN_PROGRESS for 2s [ 1218.224131] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.224389] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.224477] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.224879] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.225031] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.225287] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.225442] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.225556] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.225781] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.225917] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.226209] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.226420] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.226493] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.226693] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.226829] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.227066] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: df1e4331-4fbb-4793-8312-f3ac29ecc291 is going to be updated. [ 1218.259632] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.259883] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.260219] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.260333] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.260648] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.260893] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-df1e4331-4fbb-4793-8312-f3ac29ecc291" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.951896] env[65322]: INFO networking_nsxv3.common.synchronization [req-357a096d-5622-4cc4-902e-de2b04d3e502 req-26b03d81-c545-4faa-90e1-1c485708367b service nova] Enqueued Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_rules [ 1218.952099] env[65322]: INFO networking_nsxv3.common.synchronization [req-357a096d-5622-4cc4-902e-de2b04d3e502 req-26b03d81-c545-4faa-90e1-1c485708367b service nova] Enqueued Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_members [ 1218.952236] env[65322]: INFO networking_nsxv3.common.synchronization [req-357a096d-5622-4cc4-902e-de2b04d3e502 req-26b03d81-c545-4faa-90e1-1c485708367b service nova] Enqueued Resource ID: df1e4331-4fbb-4793-8312-f3ac29ecc291 with Priority: HIGHEST for action port [ 1218.952746] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_rules [ 1218.952874] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_members [ 1218.952966] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df1e4331-4fbb-4793-8312-f3ac29ecc291 with Priority: HIGHEST for action port [ 1218.953336] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c552e7e9-dc55-4efc-afb8-91a443d0679a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.953516] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.953610] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.953864] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.953970] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.955093] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-c552e7e9-dc55-4efc-afb8-91a443d0679a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.955093] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.955093] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.955309] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.955885] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.955885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.955885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.955885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.955885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.956146] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.956902] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-df1e4331-4fbb-4793-8312-f3ac29ecc291 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.957038] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df1e4331-4fbb-4793-8312-f3ac29ecc291" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.957128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df1e4331-4fbb-4793-8312-f3ac29ecc291" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.957332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df1e4331-4fbb-4793-8312-f3ac29ecc291" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.957435] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df1e4331-4fbb-4793-8312-f3ac29ecc291',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.459539] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.460498] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-c552e7e9-dc55-4efc-afb8-91a443d0679a taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.460606] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.460756] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df1e4331-4fbb-4793-8312-f3ac29ecc291 with status ACTIVE [ 1219.460908] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.461023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.461081] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.461278] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.461361] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.461530] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.461623] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.461674] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.461816] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.461888] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.462227] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.462227] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.462227] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.462380] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.462410] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.462503] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df1e4331-4fbb-4793-8312-f3ac29ecc291 is going to be updated. [ 1219.487293] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.487600] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.487600] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.487726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.487810] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.488024] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df1e4331-4fbb-4793-8312-f3ac29ecc291" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.662292] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4dca03f-65fb-4951-910c-8904302d70fa in Status: SUCCESS [ 1219.662292] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.813653] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e in Status: SUCCESS [ 1219.813901] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e deletion is rescheduled due to dependency. [ 1219.814022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.814610] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.814610] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.814798] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.815058] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.815058] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.815058] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.815226] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.815226] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.815403] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-4de1f800-ea47-4650-a9e7-e7000fa25d0e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.815494] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.815552] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.815703] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.815937] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.815937] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.816083] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.816204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.816289] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.816369] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.816456] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.964417] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.199977] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef in Status: SUCCESS [ 1220.200873] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.318648] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4de1f800-ea47-4650-a9e7-e7000fa25d0e: rpc.has_security_group_logging(os_id): False [ 1220.341236] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.341391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.341458] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.341677] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.341769] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.342045] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.342133] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.342200] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.342353] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.342440] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.342641] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.342735] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.342790] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.342927] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.343015] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.343197] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.343284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.343644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.343644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.343644] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.343644] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e is going to be updated. [ 1220.440870] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.441073] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.441073] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.441441] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.441441] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.467383] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.467738] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.467738] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.468052] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.468052] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.468153] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c552e7e9-dc55-4efc-afb8-91a443d0679a is going to be updated. [ 1220.474651] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e in Status: IN_PROGRESS for 2s [ 1220.521059] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.521273] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.521273] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.521473] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.521612] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.552570] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: IN_PROGRESS for 2s [ 1222.494048] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e in Status: SUCCESS [ 1222.494342] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.494796] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.495242] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.495346] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4de1f800-ea47-4650-a9e7-e7000fa25d0e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.564031] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: SUCCESS [ 1222.564179] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.564402] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.564574] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.564772] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.565599] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.565599] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.565599] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.565599] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.565599] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.565599] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.016299] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.016533] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.016533] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.016777] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.016878] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.017504] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4de1f800-ea47-4650-a9e7-e7000fa25d0e is going to be deleted. [ 1223.071368] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.073434] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.073637] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.073750] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.075133] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.075133] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.075133] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4de1f800-ea47-4650-a9e7-e7000fa25d0e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.575753] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c552e7e9-dc55-4efc-afb8-91a443d0679a: rpc.has_security_group_logging(os_id): False [ 1223.595675] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.595902] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.595975] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.596273] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.596382] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.596724] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.596868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.596935] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.597153] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.597224] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.597320] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c552e7e9-dc55-4efc-afb8-91a443d0679a is going to be updated. [ 1223.665964] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.666207] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.666318] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.666537] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.666692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.683732] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: IN_PROGRESS for 2s [ 1223.953594] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1223.953734] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1225.386583] env[65322]: INFO networking_nsxv3.common.synchronization [req-27393e42-9be5-45d6-aae6-54426fc8dc72 req-ca046ee8-500e-4b2d-9435-43feeab8c507 tempest-AttachInterfacesTestJSON-353803948 tempest-AttachInterfacesTestJSON-353803948-project-member] Enqueued Resource ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef with Priority: HIGHEST for action security_group_members [ 1225.387303] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef with Priority: HIGHEST for action security_group_members [ 1225.387657] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea14cdbb-36fa-47a7-8e0f-957145b054ef taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.387782] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.387851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.388066] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.388253] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.388356] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.388415] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.389156] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.389156] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.389156] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea14cdbb-36fa-47a7-8e0f-957145b054ef',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.702565] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: SUCCESS [ 1225.702941] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.891879] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.892134] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.892186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.892514] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.892611] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.892831] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.892992] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.893123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.893396] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.893530] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.893637] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef is going to be updated. [ 1225.927993] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.928248] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.928299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.928522] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.928661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.947679] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef in Status: IN_PROGRESS for 2s [ 1227.960108] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef in Status: SUCCESS [ 1227.960363] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef deletion is rescheduled due to dependency. [ 1227.960420] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.866889] env[65322]: INFO networking_nsxv3.common.synchronization [None req-dffbb889-e586-46f2-8e7c-1c22dbb8553e tempest-AttachInterfacesTestJSON-353803948 tempest-AttachInterfacesTestJSON-353803948-project-member] Enqueued Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 1229.867657] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGHEST for action security_group_members [ 1229.867997] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.868219] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.868324] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.868540] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.868700] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.868801] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.868865] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.869015] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.869097] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.869193] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.373973] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.374236] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.374418] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.374706] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.374812] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.375118] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.375269] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.375362] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.375608] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.375757] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.375818] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 is going to be updated. [ 1230.412451] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.412742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.412742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.412867] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.413102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.425181] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: IN_PROGRESS for 2s [ 1232.436888] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 in Status: SUCCESS [ 1232.437316] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 deletion is rescheduled due to dependency. [ 1232.437316] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.154464] env[65322]: INFO networking_nsxv3.common.synchronization [None req-a5418cee-3b6a-4a49-a72f-bd61bc67d04d None None] Enqueued Resource ID: a6558a9f-9c9b-4f95-9611-1236e095536b with Priority: HIGHEST for action port [ 1234.154890] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6558a9f-9c9b-4f95-9611-1236e095536b with Priority: HIGHEST for action port [ 1234.155352] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6558a9f-9c9b-4f95-9611-1236e095536b taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.155527] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6558a9f-9c9b-4f95-9611-1236e095536b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.155692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6558a9f-9c9b-4f95-9611-1236e095536b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.156163] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6558a9f-9c9b-4f95-9611-1236e095536b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.156315] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6558a9f-9c9b-4f95-9611-1236e095536b',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.658490] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a6558a9f-9c9b-4f95-9611-1236e095536b [ 1234.658799] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.658980] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.659091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.659481] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.659605] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.659737] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a6558a9f-9c9b-4f95-9611-1236e095536b already deleted. [ 1234.659841] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6558a9f-9c9b-4f95-9611-1236e095536b" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.750043] env[65322]: INFO networking_nsxv3.common.synchronization [None req-f0d9de49-0e10-4b70-9f0a-5fa0d7366af1 tempest-ServersV294TestFqdnHostnames-1559518747 tempest-ServersV294TestFqdnHostnames-1559518747-project-member] Enqueued Resource ID: 9c50bd64-b7a4-4f3e-b924-40c52912e3b8 with Priority: HIGHEST for action security_group_rules [ 1234.752199] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c50bd64-b7a4-4f3e-b924-40c52912e3b8 with Priority: HIGHEST for action security_group_rules [ 1234.752199] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c50bd64-b7a4-4f3e-b924-40c52912e3b8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.752199] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.752199] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.757066] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.757066] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c50bd64-b7a4-4f3e-b924-40c52912e3b8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.848160] env[65322]: INFO networking_nsxv3.common.synchronization [None req-4fecff11-bf93-4c62-96a0-399a79bd30b4 tempest-ServersV294TestFqdnHostnames-1559518747 tempest-ServersV294TestFqdnHostnames-1559518747-project-member] Enqueued Resource ID: 9c50bd64-b7a4-4f3e-b924-40c52912e3b8 with Priority: HIGHEST for action security_group_rules [ 1234.849345] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c50bd64-b7a4-4f3e-b924-40c52912e3b8 with Priority: HIGHEST for action security_group_rules [ 1234.849345] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c50bd64-b7a4-4f3e-b924-40c52912e3b8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.849345] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.279020] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.279020] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.279020] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.279020] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.279020] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.279020] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c50bd64-b7a4-4f3e-b924-40c52912e3b8 already deleted. [ 1235.279020] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.279020] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.279020] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.279020] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c50bd64-b7a4-4f3e-b924-40c52912e3b8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.698022] env[65322]: INFO networking_nsxv3.common.synchronization [req-6efece42-4d2e-4a95-b541-7af0e0d10542 req-830311e1-5d45-43c1-818e-62db38e5c6c6 tempest-ServerActionsTestOtherB-30032286 tempest-ServerActionsTestOtherB-30032286-project-member] Enqueued Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_members [ 1235.698022] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c552e7e9-dc55-4efc-afb8-91a443d0679a with Priority: HIGHEST for action security_group_members [ 1235.698022] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-c552e7e9-dc55-4efc-afb8-91a443d0679a taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.698022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.698022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.698022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.698022] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.698022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.698022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.698022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.698022] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.698022] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c552e7e9-dc55-4efc-afb8-91a443d0679a',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.802374] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.803060] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.803940] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.804844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.804844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.804844] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c50bd64-b7a4-4f3e-b924-40c52912e3b8 already deleted. [ 1235.804844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.200831] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.201028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.201093] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.201299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.201392] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.201593] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.201683] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.201748] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.201897] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.202027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.202117] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c552e7e9-dc55-4efc-afb8-91a443d0679a is going to be updated. [ 1236.229378] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.229521] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.229674] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.229890] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.230043] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.252041] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: IN_PROGRESS for 2s [ 1236.791402] env[65322]: INFO networking_nsxv3.common.synchronization [None req-701e5232-d129-442b-8b09-7b43822a27a0 None None] Enqueued Resource ID: aaa27f21-14d0-473c-becb-1d4e7e57016e with Priority: HIGHEST for action port [ 1236.792199] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aaa27f21-14d0-473c-becb-1d4e7e57016e with Priority: HIGHEST for action port [ 1236.792600] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-aaa27f21-14d0-473c-becb-1d4e7e57016e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.792742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aaa27f21-14d0-473c-becb-1d4e7e57016e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.792804] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aaa27f21-14d0-473c-becb-1d4e7e57016e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.793085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aaa27f21-14d0-473c-becb-1d4e7e57016e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.793177] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aaa27f21-14d0-473c-becb-1d4e7e57016e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.295644] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aaa27f21-14d0-473c-becb-1d4e7e57016e [ 1237.295871] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.296014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.296092] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.296319] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.296411] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.296510] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aaa27f21-14d0-473c-becb-1d4e7e57016e already deleted. [ 1237.296592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aaa27f21-14d0-473c-becb-1d4e7e57016e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.264763] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c552e7e9-dc55-4efc-afb8-91a443d0679a in Status: SUCCESS [ 1238.265256] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c552e7e9-dc55-4efc-afb8-91a443d0679a deletion is rescheduled due to dependency. [ 1238.265256] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c552e7e9-dc55-4efc-afb8-91a443d0679a" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.443548] env[65322]: INFO networking_nsxv3.common.synchronization [req-28658588-125f-4bdb-9e20-9f9ae87051b6 req-68a1aa07-66cb-426d-b778-d925726d32fa tempest-ServerActionsTestOtherA-1162989957 tempest-ServerActionsTestOtherA-1162989957-project-member] Enqueued Resource ID: e4dca03f-65fb-4951-910c-8904302d70fa with Priority: HIGHEST for action security_group_members [ 1238.444334] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4dca03f-65fb-4951-910c-8904302d70fa with Priority: HIGHEST for action security_group_members [ 1238.444563] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4dca03f-65fb-4951-910c-8904302d70fa taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.444689] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.444753] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.444957] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.445129] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.445254] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.445371] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.445467] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.445551] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.445666] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4dca03f-65fb-4951-910c-8904302d70fa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.948575] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.948772] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.948827] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.949037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.949124] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.949333] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.949433] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.949499] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.949661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.949736] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.949822] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4dca03f-65fb-4951-910c-8904302d70fa is going to be updated. [ 1238.974238] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.974407] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.974450] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.974625] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.974760] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.982542] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4dca03f-65fb-4951-910c-8904302d70fa in Status: IN_PROGRESS for 2s [ 1240.325526] env[65322]: INFO networking_nsxv3.common.synchronization [req-3e351346-7237-47ac-8f40-131dfb3f78d8 req-4dca78cb-5716-4201-bf77-a4bef6171172 tempest-ServersV294TestFqdnHostnames-1559518747 tempest-ServersV294TestFqdnHostnames-1559518747-project-member] Enqueued Resource ID: 9c50bd64-b7a4-4f3e-b924-40c52912e3b8 with Priority: HIGHEST for action security_group_members [ 1240.326135] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c50bd64-b7a4-4f3e-b924-40c52912e3b8 with Priority: HIGHEST for action security_group_members [ 1240.326445] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c50bd64-b7a4-4f3e-b924-40c52912e3b8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.326571] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.326639] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.326896] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.327063] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.327165] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.327239] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.327407] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.327496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.327588] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c50bd64-b7a4-4f3e-b924-40c52912e3b8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.636997] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-467 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.636997] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-467" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.637271] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-467" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.637528] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-467" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.637804] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.637966] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.638094] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.638379] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.638509] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.638723] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1240.638835] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1240.638950] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1240.639070] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1240.639163] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1240.639267] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1240.639397] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1240.658066] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1240.658066] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1240.658066] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1240.658066] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-467" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.658066] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-3aa65398-d76a-4385-a9ae-b96f995a46c4 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.658446] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-3aa65398-d76a-4385-a9ae-b96f995a46c4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.658446] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-3aa65398-d76a-4385-a9ae-b96f995a46c4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.658751] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-3aa65398-d76a-4385-a9ae-b96f995a46c4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.658907] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3aa65398-d76a-4385-a9ae-b96f995a46c4',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.830407] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.830611] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.830611] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.830782] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.830870] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.831076] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.831173] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.831236] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.831415] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.831496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.831532] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c50bd64-b7a4-4f3e-b924-40c52912e3b8 already deleted. [ 1240.831613] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.992621] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4dca03f-65fb-4951-910c-8904302d70fa in Status: SUCCESS [ 1240.992808] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4dca03f-65fb-4951-910c-8904302d70fa deletion is rescheduled due to dependency. [ 1240.992922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4dca03f-65fb-4951-910c-8904302d70fa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.161932] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.162215] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.162215] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.162481] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.162630] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.162781] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 3aa65398-d76a-4385-a9ae-b96f995a46c4 not found, creating... [ 1241.163044] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.163204] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.163322] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.163544] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.163820] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.163947] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.164112] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.164225] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.164425] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.164556] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.164693] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 3aa65398-d76a-4385-a9ae-b96f995a46c4 is going to be created. [ 1241.186595] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.186739] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.186865] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.187163] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.187517] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.188165] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-3aa65398-d76a-4385-a9ae-b96f995a46c4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.904857] env[65322]: INFO networking_nsxv3.common.synchronization [req-3e351346-7237-47ac-8f40-131dfb3f78d8 req-91b27ece-f3e3-46e2-b07a-d63e1196d418 service nova] Enqueued Resource ID: 9c50bd64-b7a4-4f3e-b924-40c52912e3b8 with Priority: HIGHEST for action security_group_rules [ 1241.905573] env[65322]: INFO networking_nsxv3.common.synchronization [req-3e351346-7237-47ac-8f40-131dfb3f78d8 req-91b27ece-f3e3-46e2-b07a-d63e1196d418 service nova] Enqueued Resource ID: 9c50bd64-b7a4-4f3e-b924-40c52912e3b8 with Priority: HIGHEST for action security_group_members [ 1241.905573] env[65322]: INFO networking_nsxv3.common.synchronization [req-3e351346-7237-47ac-8f40-131dfb3f78d8 req-91b27ece-f3e3-46e2-b07a-d63e1196d418 service nova] Enqueued Resource ID: 3aa65398-d76a-4385-a9ae-b96f995a46c4 with Priority: HIGHEST for action port [ 1241.905573] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c50bd64-b7a4-4f3e-b924-40c52912e3b8 with Priority: HIGHEST for action security_group_rules [ 1241.905573] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c50bd64-b7a4-4f3e-b924-40c52912e3b8 with Priority: HIGHEST for action security_group_members [ 1241.905573] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3aa65398-d76a-4385-a9ae-b96f995a46c4 with Priority: HIGHEST for action port [ 1241.905975] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c50bd64-b7a4-4f3e-b924-40c52912e3b8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.906112] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.906172] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.906367] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.906440] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c50bd64-b7a4-4f3e-b924-40c52912e3b8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.907703] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c50bd64-b7a4-4f3e-b924-40c52912e3b8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.907877] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.907935] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.908585] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.908585] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.908585] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.908585] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.908585] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.908585] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.908921] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c50bd64-b7a4-4f3e-b924-40c52912e3b8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.910817] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-3aa65398-d76a-4385-a9ae-b96f995a46c4 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.910817] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3aa65398-d76a-4385-a9ae-b96f995a46c4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.910817] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3aa65398-d76a-4385-a9ae-b96f995a46c4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.910817] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3aa65398-d76a-4385-a9ae-b96f995a46c4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.910817] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3aa65398-d76a-4385-a9ae-b96f995a46c4',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.411813] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c50bd64-b7a4-4f3e-b924-40c52912e3b8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.412970] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c50bd64-b7a4-4f3e-b924-40c52912e3b8 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.413100] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.413271] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3aa65398-d76a-4385-a9ae-b96f995a46c4 with status ACTIVE [ 1242.413433] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.413539] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.413600] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.413800] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.415272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.415272] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.415272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.415272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.415272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.415272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.415272] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.415272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.415272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.415272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.415272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.415272] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3aa65398-d76a-4385-a9ae-b96f995a46c4 is going to be updated. [ 1242.435989] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.436213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.436213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.436385] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.436514] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.436670] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3aa65398-d76a-4385-a9ae-b96f995a46c4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.916962] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c50bd64-b7a4-4f3e-b924-40c52912e3b8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.419475] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.419615] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.419663] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.419869] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.420598] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.420598] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c50bd64-b7a4-4f3e-b924-40c52912e3b8 is going to be created. [ 1243.445742] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.445883] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.445950] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.446185] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.446340] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.456027] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c50bd64-b7a4-4f3e-b924-40c52912e3b8 in Status: UNINITIALIZED for 2s [ 1245.470754] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c50bd64-b7a4-4f3e-b924-40c52912e3b8 in Status: SUCCESS [ 1245.471085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.471244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.472064] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.472064] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.472262] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.472347] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.472536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.472638] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.472705] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.472870] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c50bd64-b7a4-4f3e-b924-40c52912e3b8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.975452] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c50bd64-b7a4-4f3e-b924-40c52912e3b8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.478381] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c50bd64-b7a4-4f3e-b924-40c52912e3b8: rpc.has_security_group_logging(os_id): False [ 1246.499218] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.499477] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.499477] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.500054] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.500054] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.500054] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.500246] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.500246] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.500340] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.500385] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.500467] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c50bd64-b7a4-4f3e-b924-40c52912e3b8 is going to be created. [ 1246.555973] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.556267] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.556267] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.556392] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.556571] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.567764] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c50bd64-b7a4-4f3e-b924-40c52912e3b8 in Status: IN_PROGRESS for 2s [ 1246.906677] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1246.906677] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1248.581573] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c50bd64-b7a4-4f3e-b924-40c52912e3b8 in Status: SUCCESS [ 1248.581863] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.610595] env[65322]: INFO networking_nsxv3.common.synchronization [None req-98ca046e-d4c7-4a3f-bde0-b570c243159b None None] Enqueued Resource ID: 50dbc68b-b981-4da6-8abf-bf07f322205e with Priority: HIGHEST for action port [ 1249.611128] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50dbc68b-b981-4da6-8abf-bf07f322205e with Priority: HIGHEST for action port [ 1249.611535] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-50dbc68b-b981-4da6-8abf-bf07f322205e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.611661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50dbc68b-b981-4da6-8abf-bf07f322205e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.611718] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50dbc68b-b981-4da6-8abf-bf07f322205e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.611969] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50dbc68b-b981-4da6-8abf-bf07f322205e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.612072] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50dbc68b-b981-4da6-8abf-bf07f322205e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.114406] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50dbc68b-b981-4da6-8abf-bf07f322205e [ 1250.114406] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.114406] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.114406] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.114625] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.114665] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.114795] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50dbc68b-b981-4da6-8abf-bf07f322205e already deleted. [ 1250.114866] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50dbc68b-b981-4da6-8abf-bf07f322205e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.743094] env[65322]: INFO networking_nsxv3.common.synchronization [None req-155c583a-24e6-4953-a564-19ddf1c877bb None None] Enqueued Resource ID: 35c1a3ab-47cb-4b86-ba49-dc7a8a16fd06 with Priority: HIGHEST for action port [ 1251.743864] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35c1a3ab-47cb-4b86-ba49-dc7a8a16fd06 with Priority: HIGHEST for action port [ 1251.743864] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-35c1a3ab-47cb-4b86-ba49-dc7a8a16fd06 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.744065] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35c1a3ab-47cb-4b86-ba49-dc7a8a16fd06" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.744065] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35c1a3ab-47cb-4b86-ba49-dc7a8a16fd06" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.744280] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35c1a3ab-47cb-4b86-ba49-dc7a8a16fd06" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.744360] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35c1a3ab-47cb-4b86-ba49-dc7a8a16fd06',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.246737] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 35c1a3ab-47cb-4b86-ba49-dc7a8a16fd06 [ 1252.246924] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.247019] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.247114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.247444] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.247523] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.247617] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:35c1a3ab-47cb-4b86-ba49-dc7a8a16fd06 already deleted. [ 1252.247699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35c1a3ab-47cb-4b86-ba49-dc7a8a16fd06" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.312560] env[65322]: INFO networking_nsxv3.common.synchronization [req-2d65de9b-e9c7-4aa0-8560-65cd8ffb2394 req-d90e01d0-da96-4b11-989e-241e4c8347aa tempest-ServersTestJSON-1929708501 tempest-ServersTestJSON-1929708501-project-member] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1255.313450] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1255.313836] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.313910] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.313950] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.314216] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.314369] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.314469] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.314528] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.314683] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.314765] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.314869] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.600759] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-158 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.600965] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.601102] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.601432] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.601698] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.601856] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.601971] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.602203] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.602352] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.602554] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1255.602665] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1255.602768] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1255.602874] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1255.602978] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1255.603088] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1255.603217] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1255.624578] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1255.624760] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1255.625235] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1255.625585] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.625916] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-c6f07295-5d34-425d-9457-8fe605e0e9a4 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.626132] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-c6f07295-5d34-425d-9457-8fe605e0e9a4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.626316] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-c6f07295-5d34-425d-9457-8fe605e0e9a4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.626685] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-c6f07295-5d34-425d-9457-8fe605e0e9a4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.626839] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6f07295-5d34-425d-9457-8fe605e0e9a4',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.816935] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.816935] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.817075] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.817274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.817319] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.817554] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.817655] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.817741] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.817856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.817928] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.818026] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e already deleted. [ 1255.818132] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.129710] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.129943] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.130084] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.130411] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.130632] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.130862] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port c6f07295-5d34-425d-9457-8fe605e0e9a4 not found, creating... [ 1256.131147] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.131323] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.131445] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.131687] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.131835] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.132123] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.132271] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.132385] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.132589] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.132719] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.132853] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: c6f07295-5d34-425d-9457-8fe605e0e9a4 is going to be created. [ 1256.154379] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.154625] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.154702] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.154982] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.155247] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.155522] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-c6f07295-5d34-425d-9457-8fe605e0e9a4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.410679] env[65322]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1256.411065] env[65322]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-ee0a0012-dc65-4122-b78f-22917d1624af None None] NSXv3 Agent Agent loop - iteration:3 started [ 1256.852800] env[65322]: INFO networking_nsxv3.common.synchronization [req-2d65de9b-e9c7-4aa0-8560-65cd8ffb2394 req-d448275f-165c-45db-b1f9-950df5efd07e service nova] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_rules [ 1256.852981] env[65322]: INFO networking_nsxv3.common.synchronization [req-2d65de9b-e9c7-4aa0-8560-65cd8ffb2394 req-d448275f-165c-45db-b1f9-950df5efd07e service nova] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1256.853136] env[65322]: INFO networking_nsxv3.common.synchronization [req-2d65de9b-e9c7-4aa0-8560-65cd8ffb2394 req-d448275f-165c-45db-b1f9-950df5efd07e service nova] Enqueued Resource ID: c6f07295-5d34-425d-9457-8fe605e0e9a4 with Priority: HIGHEST for action port [ 1256.853638] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_rules [ 1256.853770] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1256.853862] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6f07295-5d34-425d-9457-8fe605e0e9a4 with Priority: HIGHEST for action port [ 1256.854144] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.854267] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.854324] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.854584] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.854668] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.855506] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.855604] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.855671] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.855840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.855981] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.856073] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.856128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.856274] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.856353] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.856475] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.857173] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6f07295-5d34-425d-9457-8fe605e0e9a4 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.857317] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6f07295-5d34-425d-9457-8fe605e0e9a4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.857389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6f07295-5d34-425d-9457-8fe605e0e9a4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.857537] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6f07295-5d34-425d-9457-8fe605e0e9a4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.857574] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6f07295-5d34-425d-9457-8fe605e0e9a4',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.359850] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.360054] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.360197] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.361132] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6f07295-5d34-425d-9457-8fe605e0e9a4 with status ACTIVE [ 1257.361310] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.361425] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.361487] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.361688] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.361776] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.361939] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.362076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.362137] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.362290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.362364] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.362536] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.362639] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.362698] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.362829] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.362898] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.362978] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6f07295-5d34-425d-9457-8fe605e0e9a4 is going to be updated. [ 1257.389642] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.389866] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.389866] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.390089] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.390225] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.390391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6f07295-5d34-425d-9457-8fe605e0e9a4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.865047] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.367794] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.367993] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.367993] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.368272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.368319] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.368408] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be created. [ 1258.393423] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.393636] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.393636] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.393816] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.394049] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.403427] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: UNINITIALIZED for 2s [ 1260.416128] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1260.416473] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.416544] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.416972] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.416972] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.417130] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.417173] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.417378] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.417378] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.417513] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.417606] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.424033] env[65322]: INFO networking_nsxv3.common.synchronization [req-5780595e-7c3d-4786-b94e-1e5b8d75c360 req-f0a4a6f0-cb8c-4db5-adca-9f55875ca537 tempest-AttachVolumeNegativeTest-885508175 tempest-AttachVolumeNegativeTest-885508175-project-member] Enqueued Resource ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 with Priority: HIGHEST for action security_group_members [ 1260.424526] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 with Priority: HIGHEST for action security_group_members [ 1260.424953] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-ad7e9873-1803-4fdd-9baa-f4ca5d792011 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.425147] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.425401] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.425666] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.425895] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.426291] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.426291] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.426451] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.426793] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.427092] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ad7e9873-1803-4fdd-9baa-f4ca5d792011',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.919763] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.920057] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.920106] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.920360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.920565] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.920688] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.920766] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.920956] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.921069] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.921179] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.921350] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.921462] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.921554] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.921742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.921900] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.922015] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.922101] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.922260] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.922349] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.922432] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.922548] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.929508] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.929636] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.929697] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.930242] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.930330] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.930523] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.930625] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.930686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.930826] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.930900] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.931025] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 is going to be updated. [ 1260.968032] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.968301] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.968301] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.968536] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.968731] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.982653] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 in Status: IN_PROGRESS for 2s [ 1261.425309] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e: rpc.has_security_group_logging(os_id): False [ 1261.446910] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.447160] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.447160] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.447338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.447484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.447753] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.447849] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.447907] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.448078] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.448160] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.448329] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.448454] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.448516] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.448641] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.448705] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.448893] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.448983] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.449058] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.449190] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.449259] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.449326] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be created. [ 1261.505915] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.506164] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.506164] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.506343] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.506516] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.517371] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1263.000225] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 in Status: SUCCESS [ 1263.000752] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 deletion is rescheduled due to dependency. [ 1263.000752] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.531978] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1263.532260] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.134353] env[65322]: INFO networking_nsxv3.common.synchronization [None req-16401dd7-b542-424e-b708-4db5a6308c2b tempest-AttachVolumeNegativeTest-885508175 tempest-AttachVolumeNegativeTest-885508175-project-member] Enqueued Resource ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 with Priority: HIGHEST for action security_group_rules [ 1265.135314] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 with Priority: HIGHEST for action security_group_rules [ 1265.135388] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.135805] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.135805] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.135805] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.135805] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f680330-6db6-4fbf-a1a6-4ca180a4f9e6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.216544] env[65322]: INFO networking_nsxv3.common.synchronization [None req-bc3663a4-d692-442d-ae49-265c0b279481 tempest-AttachVolumeNegativeTest-885508175 tempest-AttachVolumeNegativeTest-885508175-project-member] Enqueued Resource ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 with Priority: HIGHEST for action security_group_rules [ 1265.217311] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 with Priority: HIGHEST for action security_group_rules [ 1265.217678] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.217807] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.657099] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.657265] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.657333] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.657539] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.658243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.658243] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 already deleted. [ 1265.658243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.658243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.658243] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.658243] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f680330-6db6-4fbf-a1a6-4ca180a4f9e6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.179585] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.180120] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.180120] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.180265] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.180321] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.180386] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 already deleted. [ 1266.180480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.218230] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1270.218649] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1272.502266] env[65322]: INFO networking_nsxv3.common.synchronization [req-e7775f7d-3b03-4ecf-82e6-ef934ccf464c req-c73b391d-4aa1-491a-93f5-faed5b3d0847 tempest-ServersTestJSON-1929708501 tempest-ServersTestJSON-1929708501-project-member] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1272.502871] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1272.503220] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.503375] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.503426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.503629] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.503801] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.503897] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.504084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.504154] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.504207] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.504297] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.820647] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-158 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.820845] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.820960] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.821252] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.821506] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.821664] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.821818] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.822054] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.822201] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.822412] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1272.822520] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1272.822637] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1272.822894] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1272.823049] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1272.823162] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1272.823630] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1272.848186] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1272.848396] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1272.848596] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1272.848829] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.849095] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-d8485c79-e2cb-4030-842e-b7a9f5460a3e taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.849270] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-d8485c79-e2cb-4030-842e-b7a9f5460a3e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.849385] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-d8485c79-e2cb-4030-842e-b7a9f5460a3e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.849716] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-d8485c79-e2cb-4030-842e-b7a9f5460a3e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.849856] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8485c79-e2cb-4030-842e-b7a9f5460a3e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.006932] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.352386] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.352701] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.352701] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.421813] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.421813] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.421813] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port d8485c79-e2cb-4030-842e-b7a9f5460a3e not found, creating... [ 1273.421813] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.421813] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.421813] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.421813] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.421813] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.421813] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.421813] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.422421] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.422421] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.422421] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.422421] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: d8485c79-e2cb-4030-842e-b7a9f5460a3e is going to be created. [ 1273.422421] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.422421] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.422421] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.422421] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.422421] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.422421] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-d8485c79-e2cb-4030-842e-b7a9f5460a3e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.510113] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.013187] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.013496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.014233] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.014233] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.014233] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.014457] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1274.042675] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.042868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.042868] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.043099] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.043241] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.053593] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1274.094034] env[65322]: INFO networking_nsxv3.common.synchronization [req-e7775f7d-3b03-4ecf-82e6-ef934ccf464c req-5e2dac79-ccef-4204-b6b3-13b754f238de service nova] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_rules [ 1274.094266] env[65322]: INFO networking_nsxv3.common.synchronization [req-e7775f7d-3b03-4ecf-82e6-ef934ccf464c req-5e2dac79-ccef-4204-b6b3-13b754f238de service nova] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1274.094430] env[65322]: INFO networking_nsxv3.common.synchronization [req-e7775f7d-3b03-4ecf-82e6-ef934ccf464c req-5e2dac79-ccef-4204-b6b3-13b754f238de service nova] Enqueued Resource ID: d8485c79-e2cb-4030-842e-b7a9f5460a3e with Priority: HIGHEST for action port [ 1274.095561] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_rules [ 1274.095719] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1274.095823] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8485c79-e2cb-4030-842e-b7a9f5460a3e with Priority: HIGHEST for action port [ 1274.096118] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.096239] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.096306] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.096564] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.096605] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.097473] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.097573] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.097782] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8485c79-e2cb-4030-842e-b7a9f5460a3e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.097887] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8485c79-e2cb-4030-842e-b7a9f5460a3e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.097949] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8485c79-e2cb-4030-842e-b7a9f5460a3e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.098133] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8485c79-e2cb-4030-842e-b7a9f5460a3e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.098208] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8485c79-e2cb-4030-842e-b7a9f5460a3e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.600028] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.600418] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.600569] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8485c79-e2cb-4030-842e-b7a9f5460a3e with status ACTIVE [ 1274.600755] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.600913] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.600978] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.601209] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.601297] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.601488] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.601587] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.601652] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.601813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.601891] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.602109] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.602219] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.602282] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.602429] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.602501] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.602585] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8485c79-e2cb-4030-842e-b7a9f5460a3e is going to be updated. [ 1274.632682] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.632882] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.632946] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.633207] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.633376] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.633568] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8485c79-e2cb-4030-842e-b7a9f5460a3e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.651740] env[65322]: INFO networking_nsxv3.common.synchronization [req-c8aa9cfa-d701-4104-b487-8add52195268 req-476b928e-00bb-4dfc-b9d0-8985484d72a8 tempest-AttachVolumeNegativeTest-885508175 tempest-AttachVolumeNegativeTest-885508175-project-member] Enqueued Resource ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 with Priority: HIGHEST for action security_group_members [ 1274.652397] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 with Priority: HIGHEST for action security_group_members [ 1274.652865] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.652865] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.652865] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.653365] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.653365] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.653588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.653588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.653743] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.653946] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.653946] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f680330-6db6-4fbf-a1a6-4ca180a4f9e6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.982114] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-318 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.982114] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-318" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.982114] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-318" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.982114] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-318" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.982366] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.982424] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.982542] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.982751] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.982923] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.983180] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1274.983291] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1274.983394] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1274.983494] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1274.983596] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1274.983727] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1274.983820] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1275.002271] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1275.002422] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1275.002568] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1275.002723] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-318" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.003229] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-343a38e5-735a-4a6e-ab14-7c466cdb9691 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.003509] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-343a38e5-735a-4a6e-ab14-7c466cdb9691" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.003709] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-343a38e5-735a-4a6e-ab14-7c466cdb9691" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.004186] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-343a38e5-735a-4a6e-ab14-7c466cdb9691" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.004411] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('343a38e5-735a-4a6e-ab14-7c466cdb9691',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.156635] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.156856] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.157013] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.157266] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.157368] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.157581] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.157729] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.157804] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.157977] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.158065] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.158150] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 already deleted. [ 1275.158230] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.506774] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.507146] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.507146] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.507525] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.507738] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.507937] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 343a38e5-735a-4a6e-ab14-7c466cdb9691 not found, creating... [ 1275.508291] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.508468] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.508602] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.508852] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.509026] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.509364] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.509553] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.509699] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.509935] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.510082] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.510209] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 343a38e5-735a-4a6e-ab14-7c466cdb9691 is going to be created. [ 1275.531862] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.532129] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.532264] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.532677] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.532865] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.533179] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-343a38e5-735a-4a6e-ab14-7c466cdb9691" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.063655] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1276.064044] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.064153] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.064283] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.064482] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.064637] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.064702] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.064871] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.064946] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.065114] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.258926] env[65322]: INFO networking_nsxv3.common.synchronization [req-c8aa9cfa-d701-4104-b487-8add52195268 req-19621c0d-221d-423a-8125-13e5a26d6923 service nova] Enqueued Resource ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 with Priority: HIGHEST for action security_group_rules [ 1276.259041] env[65322]: INFO networking_nsxv3.common.synchronization [req-c8aa9cfa-d701-4104-b487-8add52195268 req-19621c0d-221d-423a-8125-13e5a26d6923 service nova] Enqueued Resource ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 with Priority: HIGHEST for action security_group_members [ 1276.259179] env[65322]: INFO networking_nsxv3.common.synchronization [req-c8aa9cfa-d701-4104-b487-8add52195268 req-19621c0d-221d-423a-8125-13e5a26d6923 service nova] Enqueued Resource ID: 343a38e5-735a-4a6e-ab14-7c466cdb9691 with Priority: HIGHEST for action port [ 1276.259708] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 with Priority: HIGHEST for action security_group_rules [ 1276.259841] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 with Priority: HIGHEST for action security_group_members [ 1276.259997] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 343a38e5-735a-4a6e-ab14-7c466cdb9691 with Priority: HIGHEST for action port [ 1276.260377] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.260446] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.260511] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.260744] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.260784] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f680330-6db6-4fbf-a1a6-4ca180a4f9e6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.261687] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.261806] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.261862] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.262017] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.262820] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.262820] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.262820] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.262820] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.262820] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.262820] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f680330-6db6-4fbf-a1a6-4ca180a4f9e6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.263417] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-343a38e5-735a-4a6e-ab14-7c466cdb9691 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.263513] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-343a38e5-735a-4a6e-ab14-7c466cdb9691" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.263594] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-343a38e5-735a-4a6e-ab14-7c466cdb9691" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.263744] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-343a38e5-735a-4a6e-ab14-7c466cdb9691" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.263807] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('343a38e5-735a-4a6e-ab14-7c466cdb9691',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.567688] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.765674] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f680330-6db6-4fbf-a1a6-4ca180a4f9e6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.766696] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.766801] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.767014] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 343a38e5-735a-4a6e-ab14-7c466cdb9691 with status ACTIVE [ 1276.767131] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.767236] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.767300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.767497] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.767646] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.767840] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.767936] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.767998] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.768169] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.768245] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.768418] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.768509] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.768600] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.768762] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.768847] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.768928] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 343a38e5-735a-4a6e-ab14-7c466cdb9691 is going to be updated. [ 1276.789608] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.789753] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.789824] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.790046] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.790178] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.790337] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-343a38e5-735a-4a6e-ab14-7c466cdb9691" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.070036] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.271833] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f680330-6db6-4fbf-a1a6-4ca180a4f9e6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.572648] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.572861] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.572932] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.573204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.573333] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.573443] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1277.599716] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.599927] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.599927] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.600152] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.600299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.609338] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1277.773892] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.774200] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.774276] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.774528] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.774627] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.774741] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 is going to be created. [ 1277.798853] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.799090] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.799090] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.799306] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.799471] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.809916] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 in Status: UNINITIALIZED for 2s [ 1279.620381] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1279.620722] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.620916] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.621157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.621345] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.621507] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.621602] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.621767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.621852] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.621937] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.622046] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.821043] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 in Status: SUCCESS [ 1279.821300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.821552] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.821807] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.822068] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.822272] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.822376] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.822596] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.822654] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.822790] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.822910] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f680330-6db6-4fbf-a1a6-4ca180a4f9e6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.125214] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.125383] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.125451] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.125896] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.126131] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.126236] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.126284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.126529] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.126624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.126761] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.126951] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.127065] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.127125] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.127282] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.127421] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.127512] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.127576] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.127807] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.127897] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.127983] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.128086] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.325469] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f680330-6db6-4fbf-a1a6-4ca180a4f9e6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.630140] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e: rpc.has_security_group_logging(os_id): False [ 1280.676550] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.676745] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.676745] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.676977] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.677083] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.677339] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.677496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.677496] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.677706] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.677779] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.677980] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.678086] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.678145] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.678294] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.678369] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.678561] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.678661] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.678754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.679017] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.679100] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.679188] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1280.745829] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.746077] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.746077] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.746296] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.746483] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.760201] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1280.827782] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6: rpc.has_security_group_logging(os_id): False [ 1280.848084] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.848297] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.848297] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.848911] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.848911] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.848911] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.849265] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.849265] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.849265] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.849265] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.849468] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 is going to be created. [ 1280.952640] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.952640] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.952640] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.953043] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.953043] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.968743] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 in Status: IN_PROGRESS for 2s [ 1281.051534] env[65322]: INFO networking_nsxv3.common.synchronization [req-bc61ec52-a4d0-4ce9-8171-bdef5eadfdb2 req-3e066f00-cc4f-4b74-8f73-06defb474aa5 tempest-ServerActionsTestJSON-71326710 tempest-ServerActionsTestJSON-71326710-project-member] Enqueued Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_members [ 1281.051534] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_members [ 1281.051776] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.051867] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.051908] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.052613] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.052613] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.052613] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.052613] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.052887] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.052887] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.052887] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.555249] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.555440] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.555558] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.555687] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.555799] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.555998] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.556117] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.556164] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.556317] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.556376] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.556473] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d is going to be updated. [ 1281.583411] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.583624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.583624] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.583995] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.583995] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.593187] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: IN_PROGRESS for 2s [ 1282.777360] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1282.777803] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.981698] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 in Status: SUCCESS [ 1282.981955] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.603942] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: SUCCESS [ 1283.604162] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d deletion is rescheduled due to dependency. [ 1283.604241] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.059940] env[65322]: INFO networking_nsxv3.common.synchronization [req-96c1e9a1-7cfd-4d6c-bb3a-ebea322d008f req-00deba81-743c-40b2-88e8-f53f724cf745 tempest-ServersTestJSON-1929708501 tempest-ServersTestJSON-1929708501-project-member] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1284.060517] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1284.060825] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.060939] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.061015] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.061224] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.061391] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.061492] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.061555] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.061692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.061776] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.061869] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.564203] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.067334] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.570837] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.570837] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.570837] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.571165] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.571165] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.571165] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1285.598822] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.599040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.599040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.599231] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.599373] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.608429] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1287.618698] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1287.619123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.061696] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1289.062117] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1290.241358] env[65322]: INFO networking_nsxv3.common.synchronization [req-8a678933-e910-4e07-9869-5e4981310931 req-830c571e-3016-42c7-ac97-77964ef53a71 tempest-ServerActionsTestJSON-71326710 tempest-ServerActionsTestJSON-71326710-project-member] Enqueued Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_members [ 1290.242093] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_members [ 1290.242265] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.242376] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.242443] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.242641] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.242786] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.242883] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.242949] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.243225] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.243225] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.243345] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.607377] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-710 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.607573] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.607695] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.608014] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.608283] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.608444] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.608560] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.608794] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.608956] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.609201] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1290.609299] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1290.609388] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1290.609491] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1290.609799] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1290.609799] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1290.609799] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1290.629805] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1290.630058] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1290.630157] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1290.630311] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-710" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.630632] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-190c8fb5-8fcd-40de-85c2-71b689c48ea4 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.630802] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-190c8fb5-8fcd-40de-85c2-71b689c48ea4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.631086] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-190c8fb5-8fcd-40de-85c2-71b689c48ea4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.631461] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-190c8fb5-8fcd-40de-85c2-71b689c48ea4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.631602] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('190c8fb5-8fcd-40de-85c2-71b689c48ea4',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.704767] env[65322]: INFO networking_nsxv3.common.synchronization [req-010acad7-3a58-4458-bee3-041f3872bca8 req-602524c9-1adb-47c6-9489-ed2f1e181887 tempest-ServersV294TestFqdnHostnames-1559518747 tempest-ServersV294TestFqdnHostnames-1559518747-project-member] Enqueued Resource ID: 9c50bd64-b7a4-4f3e-b924-40c52912e3b8 with Priority: HIGHEST for action security_group_members [ 1290.705343] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c50bd64-b7a4-4f3e-b924-40c52912e3b8 with Priority: HIGHEST for action security_group_members [ 1290.705670] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c50bd64-b7a4-4f3e-b924-40c52912e3b8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.705812] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.705877] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.706100] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.706257] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.706356] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.706413] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.706556] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.706639] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.706727] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c50bd64-b7a4-4f3e-b924-40c52912e3b8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.745513] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.745818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.745818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.745964] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.745964] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.746181] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.746287] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.746350] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.746500] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.746574] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.746660] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d is going to be updated. [ 1290.779352] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.779611] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.779611] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.779756] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.779891] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.790197] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: IN_PROGRESS for 2s [ 1291.135128] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.135128] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.135128] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.135128] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.135128] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.135514] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 190c8fb5-8fcd-40de-85c2-71b689c48ea4 not found, creating... [ 1291.135514] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.135610] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.135715] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.136014] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.136165] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.136436] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.136585] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.136697] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.136901] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.137043] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.137180] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 190c8fb5-8fcd-40de-85c2-71b689c48ea4 is going to be created. [ 1291.159083] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.159359] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.159428] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.159664] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.159884] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.160132] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-190c8fb5-8fcd-40de-85c2-71b689c48ea4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.209618] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.209618] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.209877] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.209877] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.209960] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.210250] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.210359] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.210423] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.210582] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.210659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.210745] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c50bd64-b7a4-4f3e-b924-40c52912e3b8 is going to be updated. [ 1291.286121] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.286566] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.286566] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.286566] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.286693] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.305922] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c50bd64-b7a4-4f3e-b924-40c52912e3b8 in Status: IN_PROGRESS for 2s [ 1291.870977] env[65322]: INFO networking_nsxv3.common.synchronization [req-8a678933-e910-4e07-9869-5e4981310931 req-a8fb7923-942d-4dba-a3db-d22f9db2dae7 service nova] Enqueued Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_rules [ 1291.871166] env[65322]: INFO networking_nsxv3.common.synchronization [req-8a678933-e910-4e07-9869-5e4981310931 req-a8fb7923-942d-4dba-a3db-d22f9db2dae7 service nova] Enqueued Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_members [ 1291.871304] env[65322]: INFO networking_nsxv3.common.synchronization [req-8a678933-e910-4e07-9869-5e4981310931 req-a8fb7923-942d-4dba-a3db-d22f9db2dae7 service nova] Enqueued Resource ID: 190c8fb5-8fcd-40de-85c2-71b689c48ea4 with Priority: HIGHEST for action port [ 1291.871813] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_rules [ 1291.871985] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_members [ 1291.873287] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 190c8fb5-8fcd-40de-85c2-71b689c48ea4 with Priority: HIGHEST for action port [ 1291.873862] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.873987] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.874067] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.874266] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.874345] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.875188] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.875290] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.875480] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-190c8fb5-8fcd-40de-85c2-71b689c48ea4 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.875572] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-190c8fb5-8fcd-40de-85c2-71b689c48ea4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.875652] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-190c8fb5-8fcd-40de-85c2-71b689c48ea4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.875916] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-190c8fb5-8fcd-40de-85c2-71b689c48ea4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.875916] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('190c8fb5-8fcd-40de-85c2-71b689c48ea4',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.362923] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.363347] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.363347] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.363437] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.363484] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.378016] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 190c8fb5-8fcd-40de-85c2-71b689c48ea4 with status ACTIVE [ 1292.378231] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.378350] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.378418] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.378623] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.378714] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.378905] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.379023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.379085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.379226] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.379300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.379472] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.379560] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.379620] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.379753] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.379848] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.379900] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 190c8fb5-8fcd-40de-85c2-71b689c48ea4 is going to be updated. [ 1292.380986] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.381098] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.404813] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.405133] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.405133] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.405282] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.405338] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.405489] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-190c8fb5-8fcd-40de-85c2-71b689c48ea4" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.801093] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: SUCCESS [ 1292.801276] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d deletion is rescheduled due to dependency. [ 1292.801320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.801482] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.801691] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.801867] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.802026] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.802084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.802699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.802699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.802699] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.865845] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.305111] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.315948] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c50bd64-b7a4-4f3e-b924-40c52912e3b8 in Status: SUCCESS [ 1293.316143] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c50bd64-b7a4-4f3e-b924-40c52912e3b8 deletion is rescheduled due to dependency. [ 1293.316258] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c50bd64-b7a4-4f3e-b924-40c52912e3b8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.367839] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.469687] env[65322]: INFO networking_nsxv3.common.synchronization [req-cc7d309c-02ad-4112-ab03-a90e26cbece3 req-f849dc0b-a901-4e29-be4a-eb6fbc955aed tempest-ServersTestJSON-1929708501 tempest-ServersTestJSON-1929708501-project-member] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1293.470252] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1293.470541] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.470662] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.470728] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.470922] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.471204] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.471311] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.471365] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.471511] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.471597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.471686] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.768562] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-158 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.768779] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.768905] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.769219] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.769479] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.769640] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.769745] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.769956] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.770159] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.770385] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1293.770495] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1293.770597] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1293.770700] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1293.770804] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1293.770906] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1293.771045] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1293.791056] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1293.791257] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1293.791359] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1293.791532] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.791846] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-f52e122d-e869-4f8d-933a-15bcb532d2ae taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.792026] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-f52e122d-e869-4f8d-933a-15bcb532d2ae" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.792144] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-f52e122d-e869-4f8d-933a-15bcb532d2ae" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.792485] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-f52e122d-e869-4f8d-933a-15bcb532d2ae" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.792620] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f52e122d-e869-4f8d-933a-15bcb532d2ae',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.809902] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.871127] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1293.871354] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1293.974256] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.295494] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.295843] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.296007] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.296334] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.296512] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.296755] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port f52e122d-e869-4f8d-933a-15bcb532d2ae not found, creating... [ 1294.296985] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.297184] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.297319] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.297572] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.297778] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.298180] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.298354] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.298471] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.298683] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.298945] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.299149] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: f52e122d-e869-4f8d-933a-15bcb532d2ae is going to be created. [ 1294.312889] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.313136] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.313136] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.313314] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.313402] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.313503] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d is going to be updated. [ 1294.338332] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.338646] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.338646] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.338911] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.339156] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.339380] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-f52e122d-e869-4f8d-933a-15bcb532d2ae" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.356805] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.357037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.357037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.357235] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.357566] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.368089] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: IN_PROGRESS for 2s [ 1294.477133] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.835938] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.836166] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.836166] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.836495] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.847801] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1294.848834] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.850515] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1294.889255] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.889506] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.889506] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.889651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.903033] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.903850] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1294.904023] env[65322]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65322) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1294.904023] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1294.948770] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.948939] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.948992] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.949216] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.950614] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.950799] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1294.979574] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.979776] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.979776] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.980023] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.980136] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.980246] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1295.017924] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.018203] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.018203] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.018356] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.018488] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.031082] env[65322]: INFO networking_nsxv3.common.synchronization [req-cc7d309c-02ad-4112-ab03-a90e26cbece3 req-2be95d9f-1747-4cbf-ae92-521e1823a120 service nova] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_rules [ 1295.031082] env[65322]: INFO networking_nsxv3.common.synchronization [req-cc7d309c-02ad-4112-ab03-a90e26cbece3 req-2be95d9f-1747-4cbf-ae92-521e1823a120 service nova] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1295.031930] env[65322]: INFO networking_nsxv3.common.synchronization [req-cc7d309c-02ad-4112-ab03-a90e26cbece3 req-2be95d9f-1747-4cbf-ae92-521e1823a120 service nova] Enqueued Resource ID: f52e122d-e869-4f8d-933a-15bcb532d2ae with Priority: HIGHEST for action port [ 1295.032227] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1295.032718] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_rules [ 1295.032851] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1295.032946] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f52e122d-e869-4f8d-933a-15bcb532d2ae with Priority: HIGHEST for action port [ 1295.033238] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.033359] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.033424] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.033620] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.033698] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.034580] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.034653] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.034819] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-f52e122d-e869-4f8d-933a-15bcb532d2ae taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.034918] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f52e122d-e869-4f8d-933a-15bcb532d2ae" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.034979] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f52e122d-e869-4f8d-933a-15bcb532d2ae" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.035151] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f52e122d-e869-4f8d-933a-15bcb532d2ae" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.035224] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f52e122d-e869-4f8d-933a-15bcb532d2ae',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.072724] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.072978] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.072978] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.073268] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.073572] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.073837] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1295.157269] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.157434] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.157507] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.157731] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.158120] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.158427] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:45. [ 1295.158558] env[65322]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'a34cfbc5-e3ce-4943-8058-702a82703915', 'ad7e9873-1803-4fdd-9baa-f4ca5d792011', '7bf5edc0-c1b5-489c-9093-35e6cf4bd266', '5ce3cc37-b73f-4ecb-b24a-2b06775793e8', 'ea14cdbb-36fa-47a7-8e0f-957145b054ef', '1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d', 'd5b6c61f-b9c6-44e9-934b-c9925befabf7', 'f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e', '42a0bf4e-f927-429d-910f-f0fec4b5f3c8', '4626348e-744c-4112-93ab-23fef8bda9e2', 'ff72da15-0579-4c17-8921-0de51b66ecbf', 'ad4a2118-b75b-4683-89be-e12ef55e1faa', 'de8176a8-b776-46da-b656-af62ce663e0d', '1f680330-6db6-4fbf-a1a6-4ca180a4f9e6', '2d8cdb67-7719-40d5-8ef7-63d3e76937f0', '102dbac2-73ae-49a6-b7c8-8cf31712d5ac', 'e863a544-814a-4bca-b4b1-35f9a61afcd3', '9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90', 'dae95ed3-e249-4093-bc1a-6e3471cc5953', '06de8ea8-08fd-4206-a96b-fafa1c856867', 'eaa0f90e-1315-418b-970b-11723b551de1', '9c50bd64-b7a4-4f3e-b924-40c52912e3b8', 'c552e7e9-dc55-4efc-afb8-91a443d0679a', '506e677b-3a46-4740-8e93-f6dcf6d18933', '108c844e-abaf-4512-b72b-84435bbf4e4e', '0300d669-cfda-4a93-9701-2092bc2115c1', '260ad733-0f5d-43fb-be04-c8ecbbbcea08', 'e4dca03f-65fb-4951-910c-8904302d70fa', '1910b456-4028-4614-b7d7-a391136f7ea1', '16e74223-ca0b-4bfa-ae4c-e7eb8d27fb16', '7f4b8024-2bac-4f34-a6d3-9d32d83408c9', '13d294c9-5967-4aff-b987-840ca5e2ead4', 'aa7cb676-7b51-4e93-980a-5540e7a7e88b', '8b1004ed-a355-46ec-ae3c-a4e6ed7a5bfd', '429d42d7-e5e7-4ade-9c7f-c5151648e98f', '739eb2bf-8f60-406e-b099-1671d90b8545', 'f71805db-9045-455c-ad23-3895d2f4e721', 'bde2ba93-08d3-4359-9ce7-0ff97de68964', '1d03ae1b-566c-4270-87f0-fce3e636d072', '51992ebb-4768-42b5-9c53-db9beef2ee89', 'fbf21d11-c10d-47fc-811b-f6af5267a9d6', 'b43d5c58-0cb4-4f14-b009-7fe58147ee41', '694536fa-8e1e-4cf0-9017-118a0337a180', '67117db1-586f-43f8-920a-dd7b8767d9ec', '08f780ea-bce2-462d-b3b7-63ec1260a6bb'} {{(pid=65322) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1295.158745] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1295.178545] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.178726] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.179032] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.179222] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.179356] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.179501] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1295.179578] env[65322]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65322) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1295.179658] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1295.295747] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.295747] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.295747] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.296649] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.297397] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.297820] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1295.297956] env[65322]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65322) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1295.298046] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1295.298127] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1295.298193] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/45 resources of Type:Security Group Rules [ 1295.298252] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGH for action security_group_rules [ 1295.298396] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 with Priority: HIGH for action security_group_rules [ 1295.298396] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 with Priority: HIGH for action security_group_rules [ 1295.298602] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 with Priority: HIGH for action security_group_rules [ 1295.298602] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef with Priority: HIGH for action security_group_rules [ 1295.298602] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGH for action security_group_rules [ 1295.298602] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 with Priority: HIGH for action security_group_rules [ 1295.298814] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGH for action security_group_rules [ 1295.298814] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 with Priority: HIGH for action security_group_rules [ 1295.298814] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4626348e-744c-4112-93ab-23fef8bda9e2 with Priority: HIGH for action security_group_rules [ 1295.298927] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ff72da15-0579-4c17-8921-0de51b66ecbf with Priority: HIGH for action security_group_rules [ 1295.298927] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ad4a2118-b75b-4683-89be-e12ef55e1faa with Priority: HIGH for action security_group_rules [ 1295.298994] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: de8176a8-b776-46da-b656-af62ce663e0d with Priority: HIGH for action security_group_rules [ 1295.298994] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 with Priority: HIGH for action security_group_rules [ 1295.299077] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 with Priority: HIGH for action security_group_rules [ 1295.299110] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac with Priority: HIGH for action security_group_rules [ 1295.299223] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGH for action security_group_rules [ 1295.299278] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 with Priority: HIGH for action security_group_rules [ 1295.299278] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 with Priority: HIGH for action security_group_rules [ 1295.299488] env[65322]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGH for action security_group_rules [ 1295.299488] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.537042] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.537378] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.537378] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f52e122d-e869-4f8d-933a-15bcb532d2ae with status ACTIVE [ 1295.537521] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.537622] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.537687] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.537974] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.538114] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.538281] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.538365] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.538427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.538598] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.538739] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.538869] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.538966] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.539093] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.540049] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.540049] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.540049] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f52e122d-e869-4f8d-933a-15bcb532d2ae is going to be updated. [ 1295.562112] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.562687] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.562774] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.562962] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.563110] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.563266] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f52e122d-e869-4f8d-933a-15bcb532d2ae" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.378889] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: SUCCESS [ 1296.379177] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.379389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.379659] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.379896] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.380055] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.380145] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.380333] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.380437] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.380548] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.380670] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.883502] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.043259] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1297.043501] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.043634] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.043874] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.044124] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.044308] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.044421] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.044675] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.044804] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.044948] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.386523] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d: rpc.has_security_group_logging(os_id): False [ 1297.404746] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.404952] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.404952] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.405149] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.426635] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.426931] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.427060] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.427130] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.427344] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.427442] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.427532] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d is going to be updated. [ 1297.491323] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.491531] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.491531] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.491730] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.491877] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.509849] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: IN_PROGRESS for 2s [ 1297.547399] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.050638] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.553956] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.554186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.554186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.554353] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.554449] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.554555] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1298.582944] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.583163] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.583163] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.583365] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.583504] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.592084] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1299.530154] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: SUCCESS [ 1299.530511] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.034413] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1300.034542] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=2 [ 1300.034687] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a34cfbc5-e3ce-4943-8058-702a82703915 with Priority: HIGH for action security_group_rules [ 1300.034839] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 with Priority: HIGH for action security_group_rules [ 1300.035148] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 with Priority: HIGH for action security_group_rules [ 1300.035148] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 with Priority: HIGH for action security_group_rules [ 1300.035148] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 with Priority: HIGH for action security_group_rules [ 1300.035353] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 with Priority: HIGH for action security_group_rules [ 1300.035353] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 with Priority: HIGH for action security_group_rules [ 1300.035430] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 with Priority: HIGH for action security_group_rules [ 1300.035475] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 with Priority: HIGH for action security_group_rules [ 1300.035562] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac with Priority: HIGH for action security_group_rules [ 1300.035647] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de8176a8-b776-46da-b656-af62ce663e0d with Priority: HIGH for action security_group_rules [ 1300.035730] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad4a2118-b75b-4683-89be-e12ef55e1faa with Priority: HIGH for action security_group_rules [ 1300.035812] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff72da15-0579-4c17-8921-0de51b66ecbf with Priority: HIGH for action security_group_rules [ 1300.035896] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4626348e-744c-4112-93ab-23fef8bda9e2 with Priority: HIGH for action security_group_rules [ 1300.035981] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 with Priority: HIGH for action security_group_rules [ 1300.036083] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGH for action security_group_rules [ 1300.036224] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGH for action security_group_rules [ 1300.036224] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef with Priority: HIGH for action security_group_rules [ 1300.036317] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 with Priority: HIGH for action security_group_rules [ 1300.036425] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 with Priority: HIGH for action security_group_rules [ 1300.036748] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a34cfbc5-e3ce-4943-8058-702a82703915 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.036861] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.036925] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.037146] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.037229] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a34cfbc5-e3ce-4943-8058-702a82703915',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.038293] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7bf5edc0-c1b5-489c-9093-35e6cf4bd266 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.038452] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.038452] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.038609] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.038681] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7bf5edc0-c1b5-489c-9093-35e6cf4bd266',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.039564] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d5b6c61f-b9c6-44e9-934b-c9925befabf7 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.039683] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.039740] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.039910] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.039978] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d5b6c61f-b9c6-44e9-934b-c9925befabf7',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.040994] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d8cdb67-7719-40d5-8ef7-63d3e76937f0 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.041146] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.041146] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.041296] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.041363] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d8cdb67-7719-40d5-8ef7-63d3e76937f0',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.042156] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06de8ea8-08fd-4206-a96b-fafa1c856867 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.042332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.042752] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.042971] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.042971] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06de8ea8-08fd-4206-a96b-fafa1c856867',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.043650] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dae95ed3-e249-4093-bc1a-6e3471cc5953 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.043757] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.043799] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.043934] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.044016] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dae95ed3-e249-4093-bc1a-6e3471cc5953',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.044896] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.044896] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.044896] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.045058] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.045058] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.045843] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e863a544-814a-4bca-b4b1-35f9a61afcd3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.045937] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.045999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.046154] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.046229] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e863a544-814a-4bca-b4b1-35f9a61afcd3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.046916] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.047027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.047142] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.047233] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.047300] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f680330-6db6-4fbf-a1a6-4ca180a4f9e6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.047984] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-102dbac2-73ae-49a6-b7c8-8cf31712d5ac taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.048101] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.048167] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.048315] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.048385] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('102dbac2-73ae-49a6-b7c8-8cf31712d5ac',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.049093] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de8176a8-b776-46da-b656-af62ce663e0d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.049192] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.049240] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.049393] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.049472] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de8176a8-b776-46da-b656-af62ce663e0d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.050350] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad4a2118-b75b-4683-89be-e12ef55e1faa taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.050350] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.050480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.050586] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.050629] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad4a2118-b75b-4683-89be-e12ef55e1faa',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.051289] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff72da15-0579-4c17-8921-0de51b66ecbf taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.051376] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.051446] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.051588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.051657] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff72da15-0579-4c17-8921-0de51b66ecbf',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.052333] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4626348e-744c-4112-93ab-23fef8bda9e2 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.052427] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.052494] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.052721] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.052721] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4626348e-744c-4112-93ab-23fef8bda9e2',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.053522] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-42a0bf4e-f927-429d-910f-f0fec4b5f3c8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.053653] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.053653] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.053808] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.053879] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('42a0bf4e-f927-429d-910f-f0fec4b5f3c8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.054558] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.054667] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.054710] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.054851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.054920] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.055573] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.055660] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.055906] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea14cdbb-36fa-47a7-8e0f-957145b054ef taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.055993] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.056040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.056499] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.056499] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea14cdbb-36fa-47a7-8e0f-957145b054ef',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.056918] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ad7e9873-1803-4fdd-9baa-f4ca5d792011 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.057044] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.057044] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.057162] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.057225] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ad7e9873-1803-4fdd-9baa-f4ca5d792011',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.057992] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ce3cc37-b73f-4ecb-b24a-2b06775793e8 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.058129] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.058184] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.058300] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.058380] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ce3cc37-b73f-4ecb-b24a-2b06775793e8',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.081257] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.081257] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.081257] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.081257] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.103076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.103217] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d8cdb67-7719-40d5-8ef7-63d3e76937f0 is going to be deleted. [ 1300.158022] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.158244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.158244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.158499] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.158670] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.158885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d8cdb67-7719-40d5-8ef7-63d3e76937f0" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.565315] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.565760] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.565760] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.565760] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.566344] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.566463] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.566524] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.566679] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.566767] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.566852] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.566938] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f680330-6db6-4fbf-a1a6-4ca180a4f9e6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.568473] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.568588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.568632] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.568771] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.568910] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.569010] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.569073] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.569208] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.569295] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.569362] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.569442] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.644342] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.644564] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.644564] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.644759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.646698] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.646820] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.647505] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.647594] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.648384] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.648517] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.649206] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.649294] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.649962] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.650073] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.650710] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.650818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.651475] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.651567] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.652239] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1300.652413] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.653098] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.653192] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.653912] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.653992] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.654596] env[65322]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1300.655017] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.655111] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.655592] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.655817] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.656044] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.656150] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.656214] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.656389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.656468] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.656552] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.656641] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.658049] env[65322]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1300.658456] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.658544] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.659183] env[65322]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1300.659697] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.659697] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.660386] env[65322]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1300.660763] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.660857] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.661509] env[65322]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1300.661879] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.661970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.662571] env[65322]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1300.662936] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.663061] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.676284] env[65322]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1300.676810] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.677052] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dae95ed3-e249-4093-bc1a-6e3471cc5953 is going to be deleted. [ 1300.678042] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.678252] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.698547] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.698848] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff72da15-0579-4c17-8921-0de51b66ecbf is going to be deleted. [ 1300.699796] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.700012] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.779342] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.779534] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 102dbac2-73ae-49a6-b7c8-8cf31712d5ac is going to be deleted. [ 1300.780419] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.780637] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.799417] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.799635] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.817712] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.817966] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.819076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.819211] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 42a0bf4e-f927-429d-910f-f0fec4b5f3c8 is going to be deleted. [ 1300.820348] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.820588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.861698] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.861921] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.905919] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.906144] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad7e9873-1803-4fdd-9baa-f4ca5d792011 is going to be deleted. [ 1300.906993] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.907247] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.939873] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.940147] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.940959] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.941115] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de8176a8-b776-46da-b656-af62ce663e0d is going to be deleted. [ 1300.942026] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.942235] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.047301] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.047301] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ad4a2118-b75b-4683-89be-e12ef55e1faa is going to be deleted. [ 1301.048489] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.048796] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.051431] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.051585] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.053724] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.053828] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.075394] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.076581] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f680330-6db6-4fbf-a1a6-4ca180a4f9e6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.111293] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.111459] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4626348e-744c-4112-93ab-23fef8bda9e2 is going to be deleted. [ 1301.112445] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.112884] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.164400] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.164640] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.164640] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.164840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.165138] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.165256] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.165320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.165671] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.165873] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.165989] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.166157] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.166250] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.166309] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.166454] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.166592] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.166681] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.166740] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.166877] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.166976] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.167033] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.167120] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1301.169127] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.169255] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a34cfbc5-e3ce-4943-8058-702a82703915 is going to be deleted. [ 1301.170302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.170495] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.229202] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.229551] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.243779] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.243969] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06de8ea8-08fd-4206-a96b-fafa1c856867 is going to be deleted. [ 1301.244851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.245084] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.266166] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.266472] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.278291] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.278505] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ce3cc37-b73f-4ecb-b24a-2b06775793e8 is going to be deleted. [ 1301.279590] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.279940] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.331651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.331842] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7bf5edc0-c1b5-489c-9093-35e6cf4bd266 is going to be deleted. [ 1301.332782] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.332998] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.353393] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.353621] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.356352] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.356498] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea14cdbb-36fa-47a7-8e0f-957145b054ef is going to be deleted. [ 1301.357417] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.357646] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.445966] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.446177] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e863a544-814a-4bca-b4b1-35f9a61afcd3 is going to be deleted. [ 1301.447124] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.447366] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.454503] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.454723] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.459938] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.460124] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.479402] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.479607] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90 is going to be deleted. [ 1301.480550] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.480772] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.482267] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.482407] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.551617] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.551776] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d5b6c61f-b9c6-44e9-934b-c9925befabf7 is going to be deleted. [ 1301.552895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.553175] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.553264] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.553361] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dae95ed3-e249-4093-bc1a-6e3471cc5953" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.553728] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.553842] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.554056] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.554205] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff72da15-0579-4c17-8921-0de51b66ecbf" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.555050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.555050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.555209] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.555304] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-102dbac2-73ae-49a6-b7c8-8cf31712d5ac" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.555465] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.555630] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.555864] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.556790] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-42a0bf4e-f927-429d-910f-f0fec4b5f3c8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.556966] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.557197] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.557320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.557524] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de8176a8-b776-46da-b656-af62ce663e0d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.557701] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.558008] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.558120] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.558356] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad7e9873-1803-4fdd-9baa-f4ca5d792011" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.559392] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.559506] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.559654] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.559818] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.559900] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.560051] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea14cdbb-36fa-47a7-8e0f-957145b054ef" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.560218] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.560391] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.560509] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.560684] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ad4a2118-b75b-4683-89be-e12ef55e1faa" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.560844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.561059] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.561186] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.561328] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4626348e-744c-4112-93ab-23fef8bda9e2" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.561538] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.561701] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.561811] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.561985] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a34cfbc5-e3ce-4943-8058-702a82703915" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.562155] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.562347] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.562455] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.562612] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06de8ea8-08fd-4206-a96b-fafa1c856867" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.562794] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.562980] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.563097] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.563244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ce3cc37-b73f-4ecb-b24a-2b06775793e8" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.563402] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.563588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.563689] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.563847] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7bf5edc0-c1b5-489c-9093-35e6cf4bd266" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.570667] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.571040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.571040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.571179] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.571275] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.571421] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e863a544-814a-4bca-b4b1-35f9a61afcd3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.577977] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d: rpc.has_security_group_logging(os_id): False [ 1301.579320] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6: rpc.has_security_group_logging(os_id): False [ 1301.616505] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.616759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.616759] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.616905] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.616905] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.617044] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c1f2b20-2d36-412f-a3e4-0ac42d8fbf90" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.635778] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.636040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.636094] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.636317] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.636403] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.636731] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.636835] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.636898] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.637063] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.637138] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.637252] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d is going to be updated. [ 1301.662527] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.662766] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.662766] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.662933] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.672533] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e: rpc.has_security_group_logging(os_id): False [ 1301.718300] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.718531] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.734204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.734545] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.734651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.734719] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.734933] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.735030] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.735121] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 is going to be updated. [ 1301.736199] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.736373] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.767116] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.767350] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.777932] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.778306] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.778453] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.778533] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.778775] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.778876] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.779119] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.779245] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.779310] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.779465] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.779540] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.779731] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.779809] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.779876] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.780010] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.780091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.780173] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1301.781308] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.781468] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.781550] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.781660] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d5b6c61f-b9c6-44e9-934b-c9925befabf7" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.854217] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.854436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.854436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.854781] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.855041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.906460] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.906691] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.906691] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.906820] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.906974] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1301.922241] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: IN_PROGRESS for 2s [ 1301.929014] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 in Status: IN_PROGRESS for 2s [ 1301.973989] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1301.974288] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1301.974288] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1301.974424] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1301.974567] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.019205] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1303.938987] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: SUCCESS [ 1303.939332] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.940540] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 in Status: SUCCESS [ 1303.940725] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.034351] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1304.034578] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.034734] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.034952] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.035055] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.537267] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.537479] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.537545] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.537754] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.538995] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.539204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.539316] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.539568] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.539712] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.540015] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.540015] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.037731] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1305.037731] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1305.042268] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.042421] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.042421] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.042635] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.042800] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.042901] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.042959] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.043122] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.043209] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.043295] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.043437] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.043529] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.043586] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.043722] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.043854] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.043982] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.044085] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.044230] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.044303] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.044455] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.044571] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.547780] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e: rpc.has_security_group_logging(os_id): False [ 1305.566829] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.567087] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.567087] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.567264] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.567358] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.567586] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.567707] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.567763] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.567958] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.568049] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.568221] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.568315] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.568369] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.568508] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.568580] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.568843] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.568954] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.569061] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.569209] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.569320] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.569412] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1305.631170] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.631365] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.631437] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.631645] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.631820] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.649115] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1305.893846] env[65322]: INFO networking_nsxv3.common.synchronization [req-c96cd507-77af-494c-bcdf-42470b9cd357 req-e2b3005e-9011-4ef4-abeb-ca5835683ce9 tempest-ServersTestJSON-1929708501 tempest-ServersTestJSON-1929708501-project-member] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1305.894432] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1305.895027] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.895027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.895027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.895286] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.895286] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.895364] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.895398] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.895544] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.895657] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.895733] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.398179] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.900983] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.404137] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.404505] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.404505] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.404577] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.404711] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.404786] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1307.432563] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.432713] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.432798] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.433282] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.433282] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.442672] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1307.665404] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1307.665620] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.452260] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1309.452679] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.895773] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1310.896201] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1314.971577] env[65322]: INFO networking_nsxv3.common.synchronization [req-fc55e902-5a3f-48c3-a432-5a78838f62cb req-a237d67d-8b5b-4138-a0b2-d6b028579409 tempest-ServersTestJSON-1929708501 tempest-ServersTestJSON-1929708501-project-member] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1314.972477] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1314.972477] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.972634] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.972634] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.972774] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.972909] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.973253] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.973253] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.973253] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.973253] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.973484] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.249219] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-158 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.249410] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.249554] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.249756] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.250124] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.250432] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.250781] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.250781] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.250889] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.251120] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1315.251356] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1315.251482] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1315.251631] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1315.251771] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1315.251891] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1315.252115] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1315.273712] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1315.273906] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1315.273995] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1315.274189] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.274534] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-169e47db-8e00-49e8-ac2f-d52fc9ad78a3 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.274937] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-169e47db-8e00-49e8-ac2f-d52fc9ad78a3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.274937] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-169e47db-8e00-49e8-ac2f-d52fc9ad78a3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.275154] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-169e47db-8e00-49e8-ac2f-d52fc9ad78a3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.275286] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('169e47db-8e00-49e8-ac2f-d52fc9ad78a3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.475642] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.778569] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.778806] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.779032] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.779236] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.779392] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.779545] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 169e47db-8e00-49e8-ac2f-d52fc9ad78a3 not found, creating... [ 1315.779797] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.779947] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.780079] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.780299] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.780429] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.780697] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.780844] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.780957] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.781175] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.781304] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.781439] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 169e47db-8e00-49e8-ac2f-d52fc9ad78a3 is going to be created. [ 1315.801076] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.801277] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.801394] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.801637] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.801854] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.802072] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-169e47db-8e00-49e8-ac2f-d52fc9ad78a3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.978951] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.480819] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.481039] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.481039] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.481251] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.481358] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.481457] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1316.491996] env[65322]: INFO networking_nsxv3.common.synchronization [req-fc55e902-5a3f-48c3-a432-5a78838f62cb req-d6b1fe8c-7ffe-4df2-b653-7cb837e1cd01 service nova] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_rules [ 1316.492198] env[65322]: INFO networking_nsxv3.common.synchronization [req-fc55e902-5a3f-48c3-a432-5a78838f62cb req-d6b1fe8c-7ffe-4df2-b653-7cb837e1cd01 service nova] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1316.492335] env[65322]: INFO networking_nsxv3.common.synchronization [req-fc55e902-5a3f-48c3-a432-5a78838f62cb req-d6b1fe8c-7ffe-4df2-b653-7cb837e1cd01 service nova] Enqueued Resource ID: 169e47db-8e00-49e8-ac2f-d52fc9ad78a3 with Priority: HIGHEST for action port [ 1316.492556] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_rules [ 1316.492756] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1316.492756] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 169e47db-8e00-49e8-ac2f-d52fc9ad78a3 with Priority: HIGHEST for action port [ 1316.493304] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.493422] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.493489] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.493801] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.493801] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.494577] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.494669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.494858] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-169e47db-8e00-49e8-ac2f-d52fc9ad78a3 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.494954] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-169e47db-8e00-49e8-ac2f-d52fc9ad78a3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.495031] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-169e47db-8e00-49e8-ac2f-d52fc9ad78a3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.495192] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-169e47db-8e00-49e8-ac2f-d52fc9ad78a3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.495265] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('169e47db-8e00-49e8-ac2f-d52fc9ad78a3',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.509047] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.509253] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.509322] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.509540] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.509704] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.522338] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1316.997415] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.997809] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.997809] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 169e47db-8e00-49e8-ac2f-d52fc9ad78a3 with status ACTIVE [ 1316.997954] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.997954] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.998136] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.998288] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.998376] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.998546] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.998640] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.998692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.998839] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.998912] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.999104] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.999192] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.999242] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.999379] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.999447] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.999529] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 169e47db-8e00-49e8-ac2f-d52fc9ad78a3 is going to be updated. [ 1317.020325] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.020594] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.020594] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.020740] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.020870] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.021046] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-169e47db-8e00-49e8-ac2f-d52fc9ad78a3" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.532370] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1318.532774] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.532774] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.532934] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.533134] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.533280] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.533348] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.533510] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.533590] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.533685] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.036036] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.538918] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.041688] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.041909] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.041994] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.042384] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.042384] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.042596] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1320.071719] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.071910] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.071910] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.072091] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.072241] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.081431] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1321.494206] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1321.494659] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1322.164441] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1322.164642] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.164762] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.164995] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.165204] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.165322] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.165388] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.165544] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.165622] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.165707] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.165796] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.668650] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.668650] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.668650] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.669209] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.669209] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.669209] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.669209] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.669209] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.669411] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.669411] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.669526] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.669618] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.669677] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.669812] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.669975] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.670050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.670097] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.670231] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.670307] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.670407] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.670479] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.174065] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e: rpc.has_security_group_logging(os_id): False [ 1323.191020] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.191236] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.191236] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.191448] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.191533] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.191746] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.191844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.191904] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.192061] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.192138] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.192310] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.192402] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.192462] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.192603] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.192675] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.192893] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.193073] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.193157] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.193306] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.193378] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.193464] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1323.255463] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.255716] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.255716] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.255870] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.256104] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.271922] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1325.291357] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1325.291778] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.495018] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1326.495351] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1330.766225] env[65322]: INFO networking_nsxv3.common.synchronization [req-e8849de4-dc91-4999-a643-22d6a43a2eaf req-2eb90f5e-d766-46f0-b28c-6846259f9ea0 tempest-ServersTestJSON-1929708501 tempest-ServersTestJSON-1929708501-project-member] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1330.766816] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1330.767047] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.767198] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.767238] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.767419] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.767568] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.767677] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.767748] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.767882] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.768037] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.768196] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.056387] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock network-158 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.056605] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.056723] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.056985] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.057294] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.057459] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.057572] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.057786] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.057925] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.058152] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1331.058277] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1331.058385] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1331.058489] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1331.058633] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1331.058755] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1331.058883] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1331.079572] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1331.079732] env[65322]: DEBUG dogpile.cache.region [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1331.079865] env[65322]: DEBUG dogpile.lock [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1331.080039] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.080353] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock port-9d1e28f0-ed0d-45de-9be3-d5018a85fc46 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.080523] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "port-9d1e28f0-ed0d-45de-9be3-d5018a85fc46" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.080628] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "port-9d1e28f0-ed0d-45de-9be3-d5018a85fc46" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.080948] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "port-9d1e28f0-ed0d-45de-9be3-d5018a85fc46" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.081092] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d1e28f0-ed0d-45de-9be3-d5018a85fc46',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.270188] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.583985] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.584228] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.584357] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.584569] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.584719] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.584870] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Segment Port 9d1e28f0-ed0d-45de-9be3-d5018a85fc46 not found, creating... [ 1331.585137] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.585292] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.585408] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.585627] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.585762] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.586052] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.586229] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.586356] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.586564] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.586693] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.586842] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Resource: SegmentPort with ID: 9d1e28f0-ed0d-45de-9be3-d5018a85fc46 is going to be created. [ 1331.609820] env[65322]: DEBUG networking_nsxv3.common.locking [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.610066] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.610163] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.610443] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.610691] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.610923] env[65322]: DEBUG oslo_concurrency.lockutils [None req-151f7213-0287-4dea-a5a3-6fdc91f968a9 None None] Releasing lock "port-9d1e28f0-ed0d-45de-9be3-d5018a85fc46" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.772132] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.274920] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.275164] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.275164] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.275374] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.275465] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.275564] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1332.309062] env[65322]: INFO networking_nsxv3.common.synchronization [req-e8849de4-dc91-4999-a643-22d6a43a2eaf req-4d28f767-453a-44a8-bbb9-cdd472babba4 service nova] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_rules [ 1332.309242] env[65322]: INFO networking_nsxv3.common.synchronization [req-e8849de4-dc91-4999-a643-22d6a43a2eaf req-4d28f767-453a-44a8-bbb9-cdd472babba4 service nova] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1332.309326] env[65322]: INFO networking_nsxv3.common.synchronization [req-e8849de4-dc91-4999-a643-22d6a43a2eaf req-4d28f767-453a-44a8-bbb9-cdd472babba4 service nova] Enqueued Resource ID: 9d1e28f0-ed0d-45de-9be3-d5018a85fc46 with Priority: HIGHEST for action port [ 1332.310515] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.310597] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.310660] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.310866] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.310968] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.312201] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_rules [ 1332.312325] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1332.312420] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d1e28f0-ed0d-45de-9be3-d5018a85fc46 with Priority: HIGHEST for action port [ 1332.312681] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.312779] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.312844] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.313014] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.313304] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.314882] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.314995] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.315209] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d1e28f0-ed0d-45de-9be3-d5018a85fc46 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.315568] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d1e28f0-ed0d-45de-9be3-d5018a85fc46" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.315568] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d1e28f0-ed0d-45de-9be3-d5018a85fc46" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.315682] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d1e28f0-ed0d-45de-9be3-d5018a85fc46" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.315717] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d1e28f0-ed0d-45de-9be3-d5018a85fc46',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.326023] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1332.815529] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.815974] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.818016] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d1e28f0-ed0d-45de-9be3-d5018a85fc46 with status ACTIVE [ 1332.818238] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.818360] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.818426] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.818632] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.818711] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.818876] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.818959] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.819038] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.819180] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.819257] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.819431] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.819518] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.819573] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.819705] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.819775] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.819856] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d1e28f0-ed0d-45de-9be3-d5018a85fc46 is going to be updated. [ 1332.840480] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.840702] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.840702] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.840879] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.841020] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.841174] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d1e28f0-ed0d-45de-9be3-d5018a85fc46" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.337698] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1334.338199] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.338199] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.338379] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.338568] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.338683] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.338747] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.338912] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.339019] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.339136] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.842037] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.343988] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.846875] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.847109] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.847109] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.847358] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.847452] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.847551] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1335.879426] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.879651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.879651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.879915] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.880076] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.889743] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1337.313379] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1337.313813] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1337.601272] env[65322]: INFO networking_nsxv3.common.synchronization [req-2d6f34ca-fe53-4306-8e8d-767e8a0ac014 req-ec0b6eeb-4833-48d0-9a93-40e3b95bf09d tempest-AttachVolumeNegativeTest-885508175 tempest-AttachVolumeNegativeTest-885508175-project-member] Enqueued Resource ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 with Priority: HIGHEST for action security_group_members [ 1337.601761] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 with Priority: HIGHEST for action security_group_members [ 1337.602084] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.602210] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.602284] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.602505] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.602663] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.602765] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.602919] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.602970] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.603305] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.603421] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f680330-6db6-4fbf-a1a6-4ca180a4f9e6',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.902721] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1337.902721] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.902721] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.902948] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.903149] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.903267] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.903334] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.903506] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.903595] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.903680] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.903770] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.106459] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.106699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.106699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.107028] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.107167] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.107416] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.107590] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.107677] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.107879] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.107988] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.108146] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 is going to be updated. [ 1338.154882] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.155158] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.155158] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.155330] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.155470] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.165390] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 in Status: IN_PROGRESS for 2s [ 1338.407113] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.407113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.407113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.407113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.407663] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.407663] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.407663] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.407663] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.407663] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.407663] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.407902] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.407902] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.407902] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.408061] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.408196] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.408321] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.408384] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.408541] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.408615] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.408693] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.408793] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.911994] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e: rpc.has_security_group_logging(os_id): False [ 1338.930362] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.930618] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.930618] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.930885] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.930998] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.931272] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.931389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.931466] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.931658] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.931766] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.931975] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.932102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.932204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.932409] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.932505] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.932761] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.932880] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.932990] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.933193] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.933299] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.933426] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1339.007880] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.008105] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.008213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.008572] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.008776] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.029888] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1340.175584] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 in Status: SUCCESS [ 1340.175994] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f680330-6db6-4fbf-a1a6-4ca180a4f9e6 deletion is rescheduled due to dependency. [ 1340.175994] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f680330-6db6-4fbf-a1a6-4ca180a4f9e6" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.047405] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1341.047706] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.795263] env[65322]: INFO networking_nsxv3.common.synchronization [req-95ec8370-ea9c-43d6-a87a-273770f3bd37 req-3df9c87d-fb2d-4711-9915-93529f1a9630 tempest-ServersTestJSON-1929708501 tempest-ServersTestJSON-1929708501-project-member] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1341.795263] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1341.795618] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.795700] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.795763] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.795957] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.796416] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.796416] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.796416] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.796548] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.796581] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.796669] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.299044] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.805535] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.307908] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.308184] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.308184] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.308393] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.308484] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.308587] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1343.348434] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.348651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.348651] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.348867] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.349015] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.361118] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1345.371654] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1345.372053] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.795747] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1346.796188] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1348.445026] env[65322]: INFO networking_nsxv3.common.synchronization [req-9a69f0ec-2937-4ae7-b797-7836df3976d1 req-335d0015-dd66-4e89-abd0-f3b3d2e39408 tempest-ServersTestJSON-1929708501 tempest-ServersTestJSON-1929708501-project-member] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1348.446461] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1348.446770] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.447692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.447692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.447692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.447692] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.447692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.447692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.447692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.447692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.447979] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.950333] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.453052] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.955480] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.955788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.955788] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.955956] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.955991] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.956116] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1349.993607] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.993806] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.993806] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.994015] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.994168] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.005395] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1352.016709] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1352.017047] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.447489] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1353.447843] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1353.509767] env[65322]: INFO networking_nsxv3.common.synchronization [req-02305f34-d9ae-43db-a21d-d6d7256b1b5c req-86ceb32a-c4b1-4f41-a278-cce2ac8bf26b tempest-ServerActionsTestJSON-71326710 tempest-ServerActionsTestJSON-71326710-project-member] Enqueued Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_members [ 1353.510334] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d with Priority: HIGHEST for action security_group_members [ 1353.510643] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.510771] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.510841] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.511054] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.511223] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1353.511351] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1353.511464] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1353.511588] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1353.511692] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.511789] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.013957] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.014224] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.014326] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.014579] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.014682] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.014858] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.014942] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.015013] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.015168] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.015244] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.015329] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d is going to be updated. [ 1354.044917] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.045071] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.045169] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.045345] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.045480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.053996] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: IN_PROGRESS for 2s [ 1356.065180] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d in Status: SUCCESS [ 1356.065569] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d deletion is rescheduled due to dependency. [ 1356.065569] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a1b9f51-2624-4aa6-bbb5-266d3b43dd7d" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.665646] env[65322]: INFO networking_nsxv3.common.synchronization [req-689e1e8d-b109-4d55-bef1-3c30804bb15f req-30816509-ca44-47dd-9d1f-f28e8f637ccd tempest-ServersTestJSON-1929708501 tempest-ServersTestJSON-1929708501-project-member] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1357.665976] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1357.666755] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.666880] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.666953] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.667201] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.667651] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.667777] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.667854] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.668011] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.668103] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.668192] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1357.922359] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-158 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.922562] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.922683] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.923089] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.923354] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.923510] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.923624] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.923834] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.923974] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.924204] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1357.924316] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1357.924422] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1357.924527] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1357.924631] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1357.924732] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1357.924860] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1357.953229] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1357.953429] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1357.953525] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1357.953697] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.954023] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-f5067c98-55cb-4fa3-a2bf-bf2e70e43b29 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.954195] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-f5067c98-55cb-4fa3-a2bf-bf2e70e43b29" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.954313] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-f5067c98-55cb-4fa3-a2bf-bf2e70e43b29" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.954702] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-f5067c98-55cb-4fa3-a2bf-bf2e70e43b29" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.954816] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5067c98-55cb-4fa3-a2bf-bf2e70e43b29',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.170492] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.456758] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.456978] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.457111] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.457399] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.457541] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.457694] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port f5067c98-55cb-4fa3-a2bf-bf2e70e43b29 not found, creating... [ 1358.457945] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.458108] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.458219] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.458431] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.458586] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.458855] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.459051] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.459143] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.459319] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.459444] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.459603] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: f5067c98-55cb-4fa3-a2bf-bf2e70e43b29 is going to be created. [ 1358.479117] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.479306] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.479376] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.479641] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.479860] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.480077] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-f5067c98-55cb-4fa3-a2bf-bf2e70e43b29" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.672960] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.175709] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.175857] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.175958] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.176163] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.176239] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.176363] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1359.178177] env[65322]: INFO networking_nsxv3.common.synchronization [req-689e1e8d-b109-4d55-bef1-3c30804bb15f req-f106e4e8-3c1a-43e1-8498-33a34ba1bdb7 service nova] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_rules [ 1359.178352] env[65322]: INFO networking_nsxv3.common.synchronization [req-689e1e8d-b109-4d55-bef1-3c30804bb15f req-f106e4e8-3c1a-43e1-8498-33a34ba1bdb7 service nova] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1359.178523] env[65322]: INFO networking_nsxv3.common.synchronization [req-689e1e8d-b109-4d55-bef1-3c30804bb15f req-f106e4e8-3c1a-43e1-8498-33a34ba1bdb7 service nova] Enqueued Resource ID: f5067c98-55cb-4fa3-a2bf-bf2e70e43b29 with Priority: HIGHEST for action port [ 1359.180469] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_rules [ 1359.180602] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1359.180699] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5067c98-55cb-4fa3-a2bf-bf2e70e43b29 with Priority: HIGHEST for action port [ 1359.181927] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.181927] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.181927] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.182373] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.182373] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.182909] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.183021] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.183225] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5067c98-55cb-4fa3-a2bf-bf2e70e43b29 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.183333] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5067c98-55cb-4fa3-a2bf-bf2e70e43b29" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.183393] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5067c98-55cb-4fa3-a2bf-bf2e70e43b29" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.183547] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5067c98-55cb-4fa3-a2bf-bf2e70e43b29" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.183614] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5067c98-55cb-4fa3-a2bf-bf2e70e43b29',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.210142] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.210341] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.210341] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.210558] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.210763] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.219640] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1359.685355] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.685686] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.685686] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f5067c98-55cb-4fa3-a2bf-bf2e70e43b29 with status ACTIVE [ 1359.685827] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.685935] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.686009] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.686312] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.686465] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.686727] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.686877] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.686972] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.687211] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.687302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.687489] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.687601] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.687665] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.687817] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.687892] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.687978] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f5067c98-55cb-4fa3-a2bf-bf2e70e43b29 is going to be updated. [ 1359.711267] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.711417] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.711488] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.711698] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.711835] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.711994] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5067c98-55cb-4fa3-a2bf-bf2e70e43b29" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.228815] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1361.229220] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.229220] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.229538] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.229764] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.229899] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.229965] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.230134] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.230254] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.230409] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.733042] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.235581] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.738804] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.739041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.739041] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.739207] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.739298] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.739399] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1362.767703] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.767905] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.767974] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.768154] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.768297] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.776890] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1364.181648] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1364.182084] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1364.786885] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1364.787129] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.787288] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.787526] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.787815] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.787941] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.788054] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.788204] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.788286] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.788373] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.788463] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.291136] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.291562] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.291562] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.291637] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.291741] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.291833] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.291898] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.292057] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.292147] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.292236] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.292387] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.292480] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.292583] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.292697] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.292833] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.292928] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.292978] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.293181] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.293265] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.293350] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.293437] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.796267] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e: rpc.has_security_group_logging(os_id): False [ 1365.814104] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.814337] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.814337] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.814523] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.814612] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.814821] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.814918] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.814976] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.815139] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.815213] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.815399] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.815530] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.815611] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.815681] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.815751] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.815940] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.816051] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.816090] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.816236] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.816342] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.816402] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1365.876387] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.876664] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.876664] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.876770] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.876897] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.891399] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1367.911756] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1367.912148] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.922024] env[65322]: INFO networking_nsxv3.common.synchronization [req-4942bfa4-57a4-4f96-bcdd-0c9f5a5916b0 req-295e9468-e015-4a29-8cf9-407202de8248 tempest-ServersTestJSON-1929708501 tempest-ServersTestJSON-1929708501-project-member] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1368.923975] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1368.924290] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.924413] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.924498] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.924670] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.924819] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.924921] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.924976] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.925118] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.925206] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.925295] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.427301] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.929902] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1370.432119] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.432343] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.432393] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.432607] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.432699] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.432797] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1370.460813] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1370.460994] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1370.461049] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1370.461236] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1370.461371] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1370.471691] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1372.484152] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1372.484600] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.924663] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1373.925090] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1377.995128] env[65322]: INFO networking_nsxv3.common.synchronization [req-21beca34-5e83-4b4f-959c-278f0dfb0eca req-c0d939f7-c6c6-4207-aaa3-fe6cfd19ee2b tempest-ServersTestJSON-1929708501 tempest-ServersTestJSON-1929708501-project-member] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1377.995128] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1377.995128] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.995128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.995128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.995128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.995128] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.995128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.995128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.995128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.995128] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.995128] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.271359] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock network-158 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.271571] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.271693] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.271959] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.272277] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.272825] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.272825] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.272825] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.272985] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.273148] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1378.273260] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] NeedRegenerationException {{(pid=65322) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1378.273363] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] no value, waiting for create lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1378.273466] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] value creation lock acquired {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1378.273571] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] No value present for key: 'zone-id' {{(pid=65322) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1378.273671] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Calling creation function for not-yet-present value {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1378.273800] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1378.295661] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1378.295873] env[65322]: DEBUG dogpile.cache.region [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65322) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1378.295960] env[65322]: DEBUG dogpile.lock [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Released creation lock {{(pid=65322) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1378.296152] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "network-158" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.296466] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock port-5f14fb02-9dd5-42e7-a34a-91657cd4d068 taken with stack trace [, , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.296639] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "port-5f14fb02-9dd5-42e7-a34a-91657cd4d068" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.296754] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "port-5f14fb02-9dd5-42e7-a34a-91657cd4d068" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.297102] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "port-5f14fb02-9dd5-42e7-a34a-91657cd4d068" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.297240] env[65322]: DEBUG networking_nsxv3.api.rpc [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f14fb02-9dd5-42e7-a34a-91657cd4d068',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.498474] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1378.799648] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.799877] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.800000] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.800310] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.800454] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.800611] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Segment Port 5f14fb02-9dd5-42e7-a34a-91657cd4d068 not found, creating... [ 1378.800860] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.801035] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.801159] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.801370] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.801497] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.801797] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.801906] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.802021] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.802219] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.802346] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.802478] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Resource: SegmentPort with ID: 5f14fb02-9dd5-42e7-a34a-91657cd4d068 is going to be created. [ 1378.822092] env[65322]: DEBUG networking_nsxv3.common.locking [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1378.822250] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1378.822324] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1378.822581] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1378.822801] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1378.823022] env[65322]: DEBUG oslo_concurrency.lockutils [None req-135c5a4f-df69-4a79-a337-ed70f9a0a691 None None] Releasing lock "port-5f14fb02-9dd5-42e7-a34a-91657cd4d068" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.000959] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.503762] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.503888] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.503992] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.504279] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.504421] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.504570] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1379.508320] env[65322]: INFO networking_nsxv3.common.synchronization [req-21beca34-5e83-4b4f-959c-278f0dfb0eca req-1c755bdc-2acd-4d9c-8b36-383e5020fe11 service nova] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_rules [ 1379.508484] env[65322]: INFO networking_nsxv3.common.synchronization [req-21beca34-5e83-4b4f-959c-278f0dfb0eca req-1c755bdc-2acd-4d9c-8b36-383e5020fe11 service nova] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1379.508615] env[65322]: INFO networking_nsxv3.common.synchronization [req-21beca34-5e83-4b4f-959c-278f0dfb0eca req-1c755bdc-2acd-4d9c-8b36-383e5020fe11 service nova] Enqueued Resource ID: 5f14fb02-9dd5-42e7-a34a-91657cd4d068 with Priority: HIGHEST for action port [ 1379.508854] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_rules [ 1379.509064] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1379.509127] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f14fb02-9dd5-42e7-a34a-91657cd4d068 with Priority: HIGHEST for action port [ 1379.509671] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.509785] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.509851] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.510044] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.510123] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.511501] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.511627] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.511903] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f14fb02-9dd5-42e7-a34a-91657cd4d068 taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.512113] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f14fb02-9dd5-42e7-a34a-91657cd4d068" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.513040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f14fb02-9dd5-42e7-a34a-91657cd4d068" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.513040] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f14fb02-9dd5-42e7-a34a-91657cd4d068" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.513040] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f14fb02-9dd5-42e7-a34a-91657cd4d068',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.534973] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.535189] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.535189] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.535401] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.535546] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.544208] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1380.012570] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.012570] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.015072] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f14fb02-9dd5-42e7-a34a-91657cd4d068 with status ACTIVE [ 1380.015197] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.015271] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.015339] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.015550] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.015662] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.015835] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.015895] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.015942] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.016102] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.016181] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.016359] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.016451] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.016511] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.016681] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.016757] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.016844] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f14fb02-9dd5-42e7-a34a-91657cd4d068 is going to be updated. [ 1380.039186] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.039390] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.039390] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.039565] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.039694] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.039854] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f14fb02-9dd5-42e7-a34a-91657cd4d068" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.553795] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1381.554203] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.554203] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.554413] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.554591] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1381.554712] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1381.554763] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1381.554957] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1381.555050] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1381.555137] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.057120] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1382.560146] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1383.062035] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.062294] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.062294] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.062487] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.062576] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.062677] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1383.092524] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1383.092742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1383.092742] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1383.092934] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1383.093096] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1383.101488] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1384.510477] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1384.510869] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1385.112371] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1385.112622] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.112787] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.113074] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.113209] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.113328] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.113389] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.113540] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.113622] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.113707] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.113797] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1385.616766] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.617298] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.617298] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.617405] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.617494] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.617603] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.617669] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.617822] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.617906] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.617997] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.618156] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.618236] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.618316] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.618436] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.618571] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1385.618660] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1385.618728] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1385.618883] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1385.618961] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.619055] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.619144] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1386.122014] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e: rpc.has_security_group_logging(os_id): False [ 1386.139618] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.139840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.139840] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.140034] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.140123] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.140337] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.140438] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.140494] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.140654] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.140730] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.140905] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.140999] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.141079] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.141208] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.141280] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.141463] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.141556] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.141609] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.141749] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.141823] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.141907] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1386.217567] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1386.217771] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1386.217824] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1386.218061] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1386.218215] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1386.237313] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1388.258046] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1388.258469] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.511877] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1389.512260] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1393.573946] env[65322]: INFO networking_nsxv3.common.synchronization [req-66906ab5-04d6-410e-a4ef-df99087a8f0d req-144d6315-412f-4786-b584-b365f9fcdc84 tempest-ServersTestJSON-1929708501 tempest-ServersTestJSON-1929708501-project-member] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1393.574525] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1393.574823] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.574942] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.575015] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.575462] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.575628] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.575733] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.575806] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.575969] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.576106] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.576215] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.078710] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1394.582067] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.084563] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.084761] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.084887] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.085133] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.085260] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.085384] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1395.114547] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.114547] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.114547] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.114547] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.114547] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.123358] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1397.134053] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1397.134394] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.575932] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1398.576356] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1399.782987] env[65322]: INFO networking_nsxv3.common.synchronization [req-f806ac61-6c3a-4f77-8994-b241f1ab3249 req-0a678106-5a05-4091-89c1-41f2e68e22af tempest-ServersTestJSON-1929708501 tempest-ServersTestJSON-1929708501-project-member] Enqueued Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1399.783509] env[65322]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e with Priority: HIGHEST for action security_group_members [ 1399.783812] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e taken with stack trace [, , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.783928] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.784302] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.784380] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.784511] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.784612] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.784675] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.784813] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.784899] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.784995] env[65322]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e',) {} {{(pid=65322) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1400.287547] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.287789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.287789] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.288027] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.288141] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.288353] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.288459] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.288520] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.288688] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.288766] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.288899] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e is going to be updated. [ 1400.317390] env[65322]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65322) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1400.317640] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1400.317640] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1400.317831] env[65322]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1400.317997] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1400.327342] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: IN_PROGRESS for 2s [ 1402.338992] env[65322]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e in Status: SUCCESS [ 1402.339409] env[65322]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e deletion is rescheduled due to dependency. [ 1402.339409] env[65322]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f81cdf4b-f86e-44f8-9f96-a59f76e4ba9e" {{(pid=65322) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1404.784857] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1404.785198] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1409.786263] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1409.786679] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1414.787079] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1414.787546] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1419.788149] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1419.788571] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1424.789598] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1424.789937] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1429.790401] env[65322]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1429.791155] env[65322]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0